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A. HISTCRICAL BACKGECUND . 


During the Presidential Administration of John Ff. 
Kennedy, Secretary of Defense Robert S. McNamara instituted 
a major revision for management of defense resources. These 
procedures were instituted as a revolution to the tnilitary 
procurement systen. Among the revisions he instituted were 
the Planning, Progranrting and Budgeting System and a nanage- 
ment system for acquisition of new major systems. 

The impact of these new proceaures on the military was 
to create an immediate need for extensive education of the 
armed services* acquisition organizations. The perscnnel in 
charge of ongoing system procurements, the project managers, 
needed améeans of kLéing educated about the systen. New 
personnel te the field of acquisition also had to havea 
means of learning abcut the systen. 

In response to the services' need, in 1963 the Defense 
Weapons Systems Management Center developed the Project 
Management Simulation Exercise (PMSE) to aid in DOD-wide 
training in project management. The exercise sinulated 
procurement of a missile system to aid the DOD-wide training 
aD ES. 

In the later 1960's, the Industrial College of the Armed 
Forces (ICAF) otktained the simulation and revised it into 
the Defense Management Simulation (DMS). DMS was installed 
at the Naval Postgraduate School ia 1971. 

The exercise currently has international application. it 
is used Ey LIsrael, Sweden and Singapore to train their 
defense personnel in the use of acquisition management 
systems. 





Agencies within the UJ. S. government currently using CMS 


or related products for training exercises include: 
e Industrial College of the Armed Forces 
e Naval Postgraduate School 
e U. S. Air Force Acadeny 


It is this wide acceftance which has maintained DMS as an 


active management training exercise. 


Be SCENARIC 


The exercise developed by DWSMC in 1963 consisted of a 
time-seguenced set of decision points in the life cycle of a 
missile system acquisition (see Figure 1.1). The decision 
points (DPs) Simulate the equivalent functions of these 
Rajor milestones in the system life cycle. Within a 
prescribed time pericd each team of students participating 
in the exercise reviews the information materials for the 
specific decision point and submits its decision for reccn- 
mended action at that point in the game, as would be dore in 
actuality. The objective is to optimize the cost effective- 
ness fcr procurement, production and development of the 
propesed new missile system, the Zebra Missile Systen. 
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Cw. SISULATION 


The team recommendations reguire monitor evaluaticn. 
Monitcrs review the student recommended performance reli- 
abilities, costs, incentives, contractor selection 
Frocesses, milestone dates and fees. They prepare materials 
for teams to interact with as they would with the Secretary 
of Defense and with the contractor. An extensive study of 
the materials from each team is reguired by the monitor. 

In crder for the monitcrs to not spend as auch tize on 
the simulation as the students, the monitors need aid in 
processing the team data. ICAF developed an Fortran progran 
called Contract Negotiation Fackage (CNP) to assist the 
Monitcr in the evaluation of student team contract 
negotiations. 

The DMS program is more than twenty years old. The 
program has experienced several modifications and offshcots. 
Its 1960's programging state-of-the-art remains acstly 
intact. Fy 1984 standards of ease of operation and user- 
friendliness, it is difficult to utilize. 

BLLOrts to @Wodity the program occurred in 1972 and in 
1977. The first attempt to upgrade the DMS program in 1$72 
modified several internal algorithms and produced an 
offshcot program which provided fewer but more rafid 
results. In 1977 this version of the program, the Contract 
Negotiation Package, was again revised. This later revision 
provided predictions of achieved values to the student 
teams. 

Team access to tke program's simulated results grew cut 
of the mcdernization cf management processes. Managers are 
uSing the tenefits of modern computer systems to imfgrcve 
their cwn performance. Student team use of the CNP program 
for the DMS exercise was a logical evolution. CNP use by the 
teams enables the DMS exercise to reach the level of current 


i 





project fanagement technolcegical support in computer-aided 
acquisition management technigues. The program also remains 
abreast through student and monitor interest in maintaining 
the program at the ccnputer support state-of-the-art. 

The CNP program available on the IBM-3033 in the WwW. R. 
Church Ccmputer Center at the Naval Postgraduate Schcol 
campus is discussed further in Chapter 2. Its disflays 
reveal CNP*'s batch fprogran origins. The data input and 
output fcermats are batch processing type fieids. The lack of 
interactive capability typifies a program which is tatch 
processed. In its batch processing use, the computer did not 
have terminals or users with which to interact. Originally 
CNP had no hardware capable of directly interacting with the 
users and its design developed accordingly. 

Modern menu-driven designs have made user-friendly 
programming standard practice. As a viable training exercise 
for acquisition management, the DMS game continues to be 
valuatle. In order to maintain its wide acceptance and 
expand its efficient utilization, a major revision to the 
program is needed. 

The foilowing chapters discuss a package of programs 
designed to give CNP an improved interactive prcgran 


Ccapatility. 


De. SUMMARY 


The DMS training pregram incorporates an exercise which 
Simulates a project management scenario. Das 1s a 
successful training device which has been in use for 20 
years. Piysupport cf OMS, the Fortran Computer program CNP 
was develcred to frovide computer-aided assistance for 
monitcr evaluation cf team performance. Later, CNP was 
released to the student teams in a format which frovides 


them with simulated performance data. It enakles team 
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interaction with the computer. In so interacting, the tean 
gains experience using the computer as an analysis tcol and 
to perform sensitivity analysis ("what if questions") on 
Major preject performance and incentive parameters. As a 
result of CNP's age, its design did not permit adequate 
interactive capability for easy operation. In order to 
resolve the need for greater user-friendliness in CNF, this 
thesis develops, studies and reports on a CNP program revi- 
Sion entitled PRCJMNC FORTRAN. 
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A. PROCEDURES 


Proficient use of the Contract Negotiation Program (CNP) 
depends upor the user's familiarity with both the computer 
facilities and with the instructions in Appendix A. The 
"Defense Management Simulation Instructions for Using CNP" 
presents computer terminal display lines as seen during a 
terminal session. In following sequentially through the 
instructions, difficulties are apparent with the prograrz 
koth in user-friendliness and in design. Appendix aA demcn- 
strates a session in CNP, and pertains to the Ecllcwing 
discussion cf that pregran. 

The procedures for accessing CNP reguire the oferatcr to 
link to the monitor's class disk, then to access the disk, 
and finally to execute CNP. Accessing the program in this 
Manner uncrmally requires at least a conceptual knowledge of 
computer command and response terminology. In the event of 
an accessing mnalfuncticn, or if the monitor is using the CNP 
program's class disk and prevents read-only execution of the 
disk files, the user may be confronted with unfamiliar 
terminology. He would need more than a casual knowledge of 
computer operaticn tc proceed into CNP. 

The first functicn performed by CNP is to input adminis- 
trative data. Included in the administrative data are the 
team numker, the decision point (DP), and the DP pages for 
which data are to te entered. Complications with the 
program guickly arise with these procedures. The data must 
be input in the exact format prescribed on the instruction 
sheet. Too many digits, cr too many spaces in the data 


result in erroneous output, and/or error statements. Each 
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page's data string reguires confirmation. This becomes 
laboricus in rereated runs of the program, or repeated 
executicas cf the calculations for a Summary Table, Table I. 

Frequently explanation is required for the procedure of 
Finary coded response to the guery for pages of data to be 
entered. Coding the page selection for data input can be 
confusing. Each of the four pages requiring input data must 


Fe indicated by "1'(cn) or ‘O"{off) in the four digit code 


Sering. Indicating the page number in Arabic characters 
would re a more commcnly expected procedure. Again, an 
error in entry is irrevocable. The change rages cannct be 


rescinded orce the binary code nas been entered. 

Having completed the administrative inputs, the tean 
proceeds with providing its proposed DP data. Preuor tc 
Euaning CNP, team participants are to have used the DMS 
Pecisicn Peint handouts ( see Appendix 8B }) to determine and 
analyze their tentative DP positions. These results are 
listed as data lines in the DMS Decision Point Sheets, 
(Appendix 8B). Each character in the page's data lines 
requires precise replication when placed in the page data 
string input to CNP. The program types the page's data back 
onto the screen and asks for confirmation. Through 
relooping to the query for fages of input, the program does 
allow revision of data. However, each data item to be 
Changed reguires an entire page change. The team is 
confronted with reentering the data string each time. This 
frocedure has preven to be tedious. It frequently results 
in téams redoing data strings several times to get then 
correct Lefcre a calculation of achieved values can Le nade. 
Successive ioops through the program have tne added check 
feature cf receiving a four line printout of the page data 
BOG CChirirMatzon. The redundant queries for coniirmaticn of 
data values have benefit in reducing erroneous data calcula- 
tions, (see Table II ). 
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Fased on the author's experience, about one out of fcur 
occasions through the four line recap of data pages, tMatle 
ti, the team finds an error. 


TABLE I 
Development Contract Values Summary 


a A i re i Ee i ee 


a 
j 


i 

| 

| DP-3 *** DEVELOPMENT CONTRACT SUMMARY *** TEAM 1 | 
INCENTIVE PROVISIONS INCENTIVE | 

ACHIEVENENTS | 

INCENTIVE WCRST BEST MAX FEE ACHIEVED | 

| AREA VALUE VALUE ALLOWED VALUE | 
| DEV. COST $ 63.04 $ 47.0M 4.0% $48.54 3] 
FIT TST COMPL 2356 WK 202 WK 3.5% 199 HK 3 
RELIA2ILITY 15.0% 217 he! 3.5% 80.0% ¢$ 
ACCURACY 160YDS 140 YDS 4.0% 143 YDS 5] 
TOTALS 15.0% 3 
TOTAL CONTRACT PRICE = $ 54.9M | 
| re ee enane 


The Development Ccntract Summary Table, Table I , neatly 
displays the decisicn point incentive input data as the 
‘Incentive provisions’. Cnly five calculated values are 
displayed to the teanz. They are the achieved values for 
develcrment cost, flight test completion date, reliability, 
accuracy, and total contract price. Also, displayed on the 
Summary Table is the computed total of fee percentages cbli- 
gated. The total fees allocated must be 15%. Ailocaticn of 
fees to other than 15% results in a warning on the Summary 
Table. The significance of the Development Contract Summary 


table and CNP rests in these five achieved values. 
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TABLE IL 
Page Data Strings 


— 
oo 


| 10301 1 1 2 fe? Oe > 0.0 
10302 S2nUUP Oe U0 me soe 50 oOe00 870200 25.00 6.00 
3.00 3.C0 6. 00 17.00 
to 30'3 $3200 47.00 4.00 238.00 202.00 a Oe oie O 
715 00 36,50 
60.00 


| 10304 1 140.00 4.00 337.00 | 


Cempared with the original CNP design, there are missing 
values from the Summary Table. It does not print out ten 
additional calculated values: the fee percentages achieved, 
their fee cest, and the totals of fees earned and of fees 
cost. These values were suppressed from the original 
program table due to their computation by incorrect algo- 
EPenges. They're suppression is evidenced by the dcllar 
Signs at the right of the Summary Table. 

To reloop through the input of data and receive ancther 


estimate of the achieved values, the team answers an wnes- 
sential query. This guestion has no applicaticn to’ the 
teams. The "CCSTS+#+FACTORS( NO)" query provides monitor 


access tc the tables cf design performance factors achieved 
and test costs in the form of unit change cost factors. the 
team's nce('N*) respcnse to, or an incorrect response to, 
this query reloops the program to the top of the main 
routine. Again, €ach question: decision point, tean, 
pages, data, yes or no, and confirm must be answered. 

It is extremely difficult to exit from the program it 
the team attempts tc stop at any point before the relcop 
guery. At the guery "DO YOU WISH TO CONTINUE, Y FOR YES, N 





FOR NC", the program provides its only graceful exit. Any 
cther attemrts to exit the program must be accomplished by 
dumping (stcpping) the progran. Inputs that do nct patch 
the data types required for’ data read-statement formats 
result in error statements, and with sufficient error occur- 


rence count the program will dump. 


Be BENEFITS 


The benefits for team utilization of CNP are in its 
ability to provide scme semblance of the achieved values 
which the main DMS batch program, provides. ITn-so dcing, 
the team uses the comruter as a tool with which to view the 
sensitivity of its incentivization parameters. It can éval- 
uate effects of varying available DMS critical incentive 
parameters: develorment cost, flight test completion date, 
reliability, accuracy and development contract price. Las 
aspect of analysis simulates the real world potential for 
computers to expedite the computations andas atool in 
these assessments. It further provides an envircnment in 
which téam particifation and success depends cn under- 
Standing the system acguisition concepts that DMS illus- 
trates. In order to expeditiously vary the parameters 
within the computer the team nust have competent knowledge 
of these DMS concepts. 

CNP's best feature appears in its structure. It closely 
follows the procedures in the DMS Decision Point Handouts, ? 
From its inception as an offshcot of the main CMS progran, 
it has inherently fcllowed the decision Doint sequence and 
structure of DMS. 
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The wide acceptance of CNP at many institutions can be 
found in the attributes it brought to DMS. In meeting the 
objectives of providing a program with the ability to 
quickly reloop through computations, and the ability to be 
operated frcem a terminal, the program fulfills a major need 
in performing certain senSitivity analyses over the DMS 
progran. Once accessed, the program can be rerun innunmer- 
able times without ccmopletely reinputting all the data. The 
data inputs can te accomplished from a terminal. Comrfuter 
Support for DMS on computer terminals has made DMS acces- 
Sible to more users without adding expense. It has enabied 
Many students to simultaneously atilize DNS as a tool in 


acquisition management training. 


Soe DEFICIENCIES 


Areas which need improvement in CNP focus on user- 
friendliness. The first of these 1s the inability tc grace- 
fully exit from the [rogram. Some means must be availatle 
to permit the team to stop the progran. Currently the 
program can only be stopped by expending time to finish the 
sessicn cr Ly generating sufficient syntax errors to force 
the ccmputer to dump the progran. In some cases, sessions 
have been in sufficient difficulty that the program would 
moemrecach the query "DO YOU WISH TO CONTINGE...". FOE this 
Situation the team is forced to generate errcer counts waich 
wili dump the progratr. These Situations have been exceed- 
ingly frustrating for the program users. 

A means to change data entries without redoing entire 
rages is needed. The team must completely redo a DP page in 
erder to change one data iten. Changing one item should 
cnly reguire reentering one value. Additionally, data 
strings from one decision roint to another are not readily 
Guplicated for input. Similar strings of data for fages on 





DP-3 and DP-4 do not have the same field format. Vaten rag 
field formats for identical pages in different DP's would 
enhance the ability cf teams to input data strings. 

CNP receives all of the input data but cannot retain it 
ketween sessions. The team starts from a baseline cf no 
data each time CNP is called. Most significant of the 
changes needed to mcdernize CNP is the creation of a data- 
Fase file to retain team data from session to session. A 
foundaticn data base of the initial paged input could 
Frovide a means of replicating session results, of docu- 
menting cata inputs, and of proceeding to successive DP 
levels without labcriously reentering previously studied 
data. 

Excessive recurrences of calculating the Summary Tatle 
could be eliminated to save team time in the ecrogran. 
Preventing runs which produce Summary Tables without correct 
incentive fee percentage totals would reduce wasted precgran 
run time. Utilizing data that does not meet the DMS parane- 
ters calculates errcreous values, and may provide Summary 
Tables which mislead the tean. Repeatedly running calcula- 
tions to evaluate wide ranges of parameter values withcut 
conducting proper preliminary analyses not only detracts 
from the timeliness of the DMS studies, it defeats the 
purpose cf DMS training teams to understand the concepts of 
project tanagement. Teams have occasionally found greater 
€ase in working thrceugh the program and produce a Summary 
Table 1n order to reach the "DO YOU WISH TO CONTINUE...?" 
query aS an expedient to reloop through or exit from the 
program. This process detracts from the educational benefit 
and timeliness of DMS. 

As part of the training Simulation, monitors spend many 
hours in analyzing the progress of the teams and the fosi- 
Hrons fcr ccntract negotiation. Analysis done by each tean 
must also Ee accomplished by the monitor to assess student 
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D. SCNITOR FUNCTIONS 


CNP provides cne additional table “for NMeEnitoOers- 
COST+FACTIORS, Table III , provides the monitor with the ccst 
for a unit increase in a system test category as well as 


with the design factcrs achieved. 


P 
| 
: 


TABLE III 
COST # FACTORS | 
| 
ij CCSTS OF TESTS PER UNIT (IN THOUSANDS OF DOLLARS) | 
CUALIFICATION TESTS 
MOTOE : 32.034 
AIR FRAME : 126.355 | 
GUIDANCE : 309.906 
FIRE CONTROL : 938.186 | 
LAUNCHER : 4242555 
FLIGHT TESTS : 316.855 | 
CESIGN FACTORS ACHIEV=D | 
COMPONENT TABLE ROW FACTOR ACHIEVED | 
MOTOR : 1 25 0.825 0.877 
| AIR FRAME : 2 15 0.958 0.980 | 
GUIDANCE A: 5 22 02666 02630 
GUIDANCE 8B : 6 25 0.580 Om | 
FIRE CONTROL : 4 16 0.845 0.802 
LAUNCHER : 3 7 0.936 0.988 
IHOOO1A PAUSE :ERESS <<ENTER>> TO CONTINUE. 
_ ee ee ee ae ee 


progress. The moniter must also create positions from which 
to interact with the teams as the contractor. Within the 
COST+tFACIORS Table, some aid exists for the monitor. 
However, his understanding cf the impact of unit-cost on the 
contract requires additional analysis time over what the 
teams spend on incentives analysis. In general, because or 


limited time the monitor has to spend analyzing each téean's 





propcsals ccmpared sith the amount of time put in ty the 
team, ccupled with the inconvenience in making repeated CNP 
runs, most monitors produce an actual DMS table printout 
corresponding to each team's froposed decision in ocrder to 
provide more detailed and accurate intormation for use 
O@ireing ccntract negotiations. It would be better fcr CNP to 
provide the information ina more usable format than to 
produce the lengthy and time consuming main exercise rerorts 
ec the DS. 


Ee SUMMARY 


The difficulties encountered in CNP detract from its 
usefulness. Time spent fighting the program protlemns are 
excessive ccmpared tc the hours availaole for productive DMS 
analysis. In an effcrt to correct these time-sinks in CNP, 
FROJMNG FCRTITRAN and its associated EXEC routines have been 
created. 
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III. PROJMNG OPERATION 


Ae CHP MODERNIZATION 


The task in creating PROJMNG FORTRAN as a revision to 
CNP was first to retain the same functional structure rela- 
tionship with DMS. This goal has been accomplished by 
incorporating the CNB subroutines into a larger frogran. 
The expansion has occurred by the added Fortran code for the 
human-factors engineered subroutines, and new sensitivity 
analysis features. The human-factors designs provide addi- 
tional user friendliness to PROJMNG. The program calcula- 
tions continue to center around the original CNP progran 
routines. Many of the achieved value parameters. and 
perfcrmance calculations are accomplished using the same 
Fortran code as used Ey CNP. CNP 1s encompassed in PROJMNG. 

Other tasks for FROJMNG FORTRAN were to correct as many 
of the discrepancies in CNP as possible, to provide an 
enhanced user-friendly training device and to improve the 
analysis capability available to the monitor. 

In modernizing CNP, the criticisms specified in Chapter 


~ 


Z were highlighted. The following areas were examined. 


ae  Lank 

2. Datakase 

3. Datakase Security 

Sie ol 

5. Data Change 

6. Menu 

7. Report Submission 

8. Mcenitor Access 

oe Sensitivity Aralysis 


10. Calculation Correction 
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Be. PROJENG PACKAGE 


This chapter discusses the features of PEOJMNG used to 
support team analysis of the exercise. The monitor capahbili- 


ties are discussed in Chapter 4. 
1. Programs 


FROJMNG consists of more files (executable programs) 
than does CNP. There are four routines utilized in 
executing PROJMNG FCETIRAN. In addition to the FPRCJMNG 
FORTRAN file, the package includes LINKPROJ EXEC (Appendix 
Cy, PRCJMNG EXEC (Appendix [), and the PROJMNG disk's 
PROFILE EXEC (Appendix £) which are discussed in détail 
throughout this thesis. 

FROJMNG FORTRAN is’ designed to = functron --alenc 
provided team files exist and have been defined for PRCJMNG 
FORTRAN as files 9 and 19; "FILEDEF 09 DISK DATAFILE TEAMxx" 
seme ‘'rTiFDEF 10 DESK BPATACODE TEAMxx". It can ke used 
without the exec rottines but at a lower level of rperforn- 
ance. PROJMNG can ke executed through the routine PRCJMNG 
AC « 

PROJMNG FORTRAN and PROJMNG EXEC are designed to 
reside cn a publicly accessible disk. In this manner 
multiple teams can wse the program simultaneously. Their 
database files will be on this one disk where they are 
conveniently accessitle for the program and the monitors. 
PROJMNG is read from this disk by the team's user disk and 
executed frem the team's disk. 

FROJMNG koth reads and writes onto its data filés. 
The IBM-3033 public, “all", link access is read-only (R/O) 
and prevents writing onto the disk. The PROJMNG disk is 
Only read capable when linked to for the exercise. However, 
the disk linking to FROJMNG can be written onto by the 
rEeog ral. A team disk linking to PROJMNG acts as the write 
disk fer the progran. 
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The ability for teams to write directly ontc the 
PROJMNG disk would ke unsatisfactory. This access to the 
Frogram would permit two detrimental erfects. The prcegran 
Might’ be either altered or destroyed by overly curious 
students entering the files, and team files might also be 
altered or destroyed. Inadvertent alteration of the files 


1s prevented by student access being limited to read only. 
2. fata files 


There are fcur files of data tables that were 
created for CNP. These tables contain the resource parame- 
ters to generate achieved values for the program calcula- 
tions. These data tables Pema nin 1£1¢eS “sD 75007, 
Pre POO’, FTISFOO?, and FIZ0FO01 as in CNP. No ccentract 
Simulaticn calculaticns can be accomplished without then. 
The program will dump when it reguires a table be read and 
does not find it. PECJMNG will also stop if the tables are 
hot in the required fcrmat. 

Freformatted catabase files must be availakle when 
the STORE and read rcutines are called by PROJMNG. Whenever 
it attemrts to write or read these data files and does not 
find them, the prcgram will dump (stop). Two of the 
remaining files are these datatase files. One is the FILE 
CATAFILE which is preformatted for the DMS data. It serves 
as a dumgy file which can be copied to initiate the team's 
databtase, DATAFILE TEAMxx. The other rile, FILE CATACODE, 
serves as a similar dummy file in the creation of the team's 
Security file, DATACCEE TEAMxx. 

CATACODE stores the team security code, the security 
code count for attempts to Ereech the code, and the USERID 
of the last team which used the file. Its data enables the 
program to use routines to check the team and validate the 


team identity through the security code. 
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If formatted files for the team are not available on 
the PROJMNG disk or the team disk, the dummy files are 
copied onto the team disk. PROJMNG EXEC reproduces the two 
dummy files on the team disk in the names DATAFILE TEAMxx 
and DATACODE TEAMxx. They are used interactively by PRCJMNG 
during the game sessions. The PROJMNG Instructions 
(Appendix F) discuss the DATABASE and DATACODE file genera- 
tion cn the team's disk. 

When the team finishes its session and exits fron 
PROJMNG FORTRAN, the last copy or the data which was stored 
Ey the program remains on the team's disk. As the computer 
executicn finishes the routine PROJMNG EXEC, these two files 
are transmitted to the PROJMNG disk. 


ce Sa. 


LINKPROJ establishes the link between the teaan's 
disk and the PRCJMNG disk. It reguires PROJMNG EXEC in 
order to run the progran. 

The routine LINKPRCJ is a CMS executive level 
Frogram which utilizes the link reature to establish the 
connecticn Letween the team's disk and the disk on which 
PROJMNG resides. © It begins the recording of the téam's 
session, "RECORD ON". This first step in LINKPROJ frovides 
a reccrd of the sessicn for review in the event PROJMNG dces 
not perfcrz as desired. Once the link has been estaklished, 
the routine sets the function of the programmable function 
key 9 (PF9) to enakle release of the link. This feature 
enables the team to release the link after a session has 
been akorted and the program stopped without completing the 
LINKPROJ EXEC. -The team would have to abort a session 
should EFERCJMNG be stuck in a continuous loop.- PFI will not 
succeed in breaking the link when PROJMNG is operating 


normally. 
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Team members should be aware of the IBM-3033 capa- 
bility to te dumped (stopped) out of CMS by executing 
<<ALTO> and <<PA1I>> Simultaneously. Executing <<FA1>> 
aborts the program without completing LINKPROJ. The 
pressing of these two keys on the IBM 3278 terminals will 
place tke virtual system into the CP level of operator 
interaction. The team can reaccess its "A" disk by executing 
the ccmmand "I CMS" and pressing <<ENTER>>; wait for the 
display to read "VM READ" and again press <<ENTERD>. The 
disk will again be in CMS and existing links will remain 
intact. In order to release the link to PROJMNG press the 
<<ALTD> and <<PF9>> simultaneously. 

LINKPROJ breaks the link. It releases the PRCJMNG 
grusk (O276P). Once the disk is released if no users are 
accessed to it, the FROJMNG disk can be logged onto in the 
readywrite mode to enable files to be written onto it. 

When LINKPROJ sends the Special message to PROJMNG'S 
amsk, “f4SG QACNT KIINE" it tells the computer to autonmati- 
cally log (autolcg) cnto the disk. Tne disk 1s activated 
in the read/write mecde only if no other user is on the 
PROUMNG disk. The files which the team sent are copied by 
mie disk*s EROFILE EXEC. 

LINKPROJ alsc terminates the recording of the 
sessicn, "RECORD OFF". 


4. PROJMNG EXEC 


ae initiate Files 


PROJMNG EXEC perirorms the checks of availatle 
miles. It determines if a formatted data file and a 
security file are available for the team. If it detects the 
moniter tnigue file, DATAINST DISKNUM, it initiates the 
monitor flag to tell FROJMNG FORTRAN the user is a monitoz. 





PROOUMNG EXEC checks first for the mcnitor's 
file, determines if the user is a team or a monitor. If the 
user 1S a team, it checks for the tean files on the PRCJMNG 
disk and uses them if available. If these files are not 
found, it will check the team disk for the files and use 
them. If the files are not found at all, the programs ccpies 
the dummy files and generates the team label and files. 


rk. Terminating the Session 


If the user 1s a monitor, PEOJMNG EXEC gueries 
him for whether he desires a concatenated listing of all of 
the team files. If he does, it spools a file with all tean 
data files on it. It then completes its execution and 
returns operation to LINKPROJ. 

For team operation, when the computer leaves 
EFROJMNG FORTRAN control, execution returns to PROJMNG EXEC. 


In order to complete the session, PROJMNG EXEC has been 
designed to transmit the data files to the PROJMNG disk. 
This feature 1S acccrplished by spooling the disk, "SPCOL 


PUNCH CONT CL X OQO27€F". The punch file created is sent to 
userid 0276F as a class x file. PROJMNG EXEC punches the 
data files onto the spool, "DUNCH DATAFILE TEAMxx", and 
closes the spool, "SFOCOL PUNCH CLOSE NOCONT", The file is 
gueued in the reader file of the PROJMNG disk (0276P). 


5. EROFILE EXEC 


f#hen LINKPROJ sends the automatic log-on message to 
the ERCJMNG disk, if no other user is on the PROJMNG disk, 
the disk is activated in the read/write mode. The main 
computer executes the disk's profile routine. PROFILE EXEC 
is performed whenever the disk is accessed in the write 
capakle rode. This exec has been uniguely tailored for this 
FROJMNG specific disk (see Appendix E ). It reads up te six 
class x files queued to the disk. Pa2bstr tne PROFILE EAEC 


a2 





sets the disk reader file to lock for class x, "SPOOL RER CL 
X", and then reads the files, een De. The program has 
been designed to reset the reader spool to spool any class. 
Upon completion cf writing files onto the disk, the command 
"SPOOL RDR CL *" returns normal spooling capability 

The PROFILE read function would nominally expect to 
find a set of files, DATAFILE TEAMxx and DATACODE TEAMxx. 
The read limit was expanded frem two files to six, fer three 
pairs, in expectaticn that there will be occasions when tke 
disk will remain in use by other teams. When other teams are 
still using the disk the autolog will be unable to perforn 
its one shot access to the disk. SMSG will not remain queued 
to access the disk. In order to read those class x files 
that may have been left waiting, subseguent running cf the 
FROFILE EXEC will read in several more files than those 
transmitted in the ctrrent PROJMNG session. The exec will 
read up to three additional pairs. 

The benefit in using the class x spooling capability 
is the cue which this class gives. It tells the disk that 
the file is a PROJMNG file. Normal spooling usage within the 
IBM 3033 does not use x. 'ZX' haS a uniqueness within the IBM 
system and will reduce the possibility of PROJMNG EXEC 
reading non-PROJMNG files. 

The files are not read onto the PROJMNG disk while 
cther users remain or the disk. Attempts to write onto the 


disk in this situaticn result in garbling the data files. 


C. DATAEASE SECORITY 


The first guery the team answers in PROJMNG is to 
provide the team numfer. 

The second questicn asks for the team to create a tean 
security code. The team may enter any code of up to eight 


characters. Pfetnewvelants Chatacters are all ZercS Of 





contain ncthing (nulls) the program will again ask the tean 
to change the code. PROJMNG begins succeeding seSsicns by 
asking tke team to match the security code stored in data 
tase, the team's security code. es 

The security code system gives the team access tc its 
Catakase while assuring that data has not been altered by 
anyone except the team or the monitor. This has benefits to 
the team and to the sSinulation. The team doesn't have to 
worry about data being changed accidently and the monitor 
has less concern that the team's work might be compromised. 
The security code is also used for proposal submissicn. fue 
to its length and inprobability of being entered ccrrectly 
by mistake, the security code performs the functicn of 
assuring the monitor of the team's intent to submit the 
Froposal as indicated. 

The monitor can change the database to correct errcrs in 
the team files. Cecrrections may become necessary if the 
team submits a report and then wants to change it. The 
proposed and final data reports for a DP are not accessitle 
cy the tean. Lack cf access to submitted reports increases 
team ccmmitment to the refort. It also, provides the 
monitor with a fixed team position reference point. This is 
critical if the monitor is to create a contractor fosition 
by which tc interact with the tean. 

The sukmission cf reports and their purpose are 
discussed in greater detail later in this chapter. 


CD. EXIT 


In PRCJMNG several sethods cf stopping the program have been 
provided. These are: 

1. Fatal errors 

2- Security violation 


3e Menu opticn 
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4. Yes/No query 


ie wade aber roge 


The computer capability to stop the program when a 
Programmed statement cannot be performed (executed) is 
referred to as a fatal error. PROJMNG has selectively modi- 
fied the fatal error response. 

The program termination in response to a null entry 
(pressing the <<ENTER>> key without providing a character 
including the character blank ‘ ') was unsatisfactory. 
Inadvertent null responses repeatedly dumped users cut of 
the program. 

To resolve the fatal error dump (stopping the 
program), a GIOBAL routine (progran which can be called 
from the IBM 3033's resident routine files) is called. The 
"CALL ERRSET' enables the program to ignore fatal errors and 
proceed with the progran. When PROJMNG finds an €frror 
during the rfrocess of reading information from the terminal, 
it performs a jump to the statement specified as the error 
default by the READ statement. Very serious errors in 
Syntax will continue to be dumped py the computer. 

Failure to answer PROJNNG's guestions satisfactorily 
will cause it to reicop to either the same question cr to 
call out the EXITS routine. If an error is serious encugh, 
me EXTTS routine wiil be called. EXITS allows termination 
of the program, or if the team wants to continue, EXITS will 
return tc the top of the last query routine and allow the 
program to reloop. Correct entry of the security code will 
give the team access to the main proyram and existing data 
files with that team's number. 
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Turing the start of a session at the terminal, the 
user will te gueried for his previously entered security 
code. The program will permit the user to answer the 
security code query incorrectly only five times during the 
course cf a DMS exercise. At occurrences of incorrect 
security code entries, a count is kept. One thie; firth ceca= 
Sion wher the code is entered incorrectly, the counter will 
tell the program to stop. Successive attempts to entera 
team file whose Security file counter has reached five will 


terminate at the security code guery. 
3. Menu 


A standard crftion in the main menu of FPRCJMNG is 
Bl T . Selecting the EXIT option directs the progranr to 
stop. Again, this operation returns computer executicn to 
the PROJMNG EXEC pregran. Completion of the PROJMNG EXEC 
run will return contrel to the LINKPROJ routine which fres- 
ents the guery for ancther run. 


4. YES/NO Query 


Each query in PROJUMNG which can be answered with a fY 
for YES or N for NC, can also be anSwered with an €E for 
BT . This E response either calls the program sukroutine 
EXITS or stops the f[rogran. EXETS gracefully stops the 
program ky permitting either return or the computer's ofera- 
tion to PRCJMNG EXEC or by reloopiag into the last query 


routine. 
5. Return to PRCJMNG EXEC 


The terminaticn of PROJMNG FORTRAN returns the 
computer execution to PROJUMNG EXEC. This routine executes a 
transpittal of all team files to the PROJMNG disk. 
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E. PRCJYNG PROCEDURES 


1. Instructions 


The procedures used with PROJMNG FORTRAN are signif- 
icantly different frem CNP. Appendix F contains the PRCJMNG 
Studeat Instructions. These instructions replicate the 
program's screen displays. Appendix F demonstrates a 
session using PRCJMNG. Checks and corrective procedures in 
FROJMNG render the making of errors MOre diEltacult, 
However, some examples are demonstrated in the PRCJMNG 
Student Instruction'ts tutorial. 


2 eee Kk 


The instructions ask the team to access PRCJMNG 
solely by executing the command LINKPROJ. This command runs 
the program LINKPROJ EXEC. LINKPROJ EXEC is a routine which 
creates the disk link and accesses PROJMNG as the user's ‘C°! 
disk, as discussed akove. This exec must be placed on the 
team disk. From there it is able to link and access 
PROJMNG's disk for the tean. 

Among the capabilities of LINKPROJ are the defini- 
tion cf frogrammable key PF9. This function can be executed 
ky pressing <<ALT>> and <<PF9>> simultaneously. 

LINKPROJ also executes a pair of calls to the macro 
computer program routine “RECORD". The Wrest Of Chis pare 
enables the recording of all session terminal activity. the 
latter executes after the session has been completed; it 
terminates the record of the session. Teams sShouid be aware 
that if the program dumps or they exit the program without 
performing the "RECCHD OFF", the record will continue in 
effect. It can be closed by inputting the command "RECORD 
err! fermination cf the record permits the team to either 
Mame and save the session's record on disk, to edit it, to 


Heint it, to quit it ("QO") which places it on the disk 
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Spool, cr tO purge the record. AdGBELON- Ofethis Carabi lity 
permits review of tear session. Undetected ditficulties or 
€rrors that result in program malfunction can be reviewed. 

In erder to facilitate rerunning of LINKPRCJ, the 
routine does query whether the team wishes to run "ANCTHER 
RUN, Y/N". This feature iS one which LINKPROJ holds in 
common with the other programs in the PROJMNG package of 
routines. PROJMNG is designed to allow the team tc terni- 
nate or reloop through program execution. 

The running of PROJMNG FORTRAN does not occcur fron 
LINKPROJ. LINKPROJ gcuns limited functions already sfeci- 
fied, and calls the FROJMNG disk's program PROJMNG EXEC. 


3. EROJMNG EXEC Execution 


PROJMNG EXEC serves several functions in preparing 


the téam disk for the session. 
ae Team Disk Status 


The PROJMNG EXEC routine provides several 
gueries to the team disk. Through the response error return 
codes it receives indication of the availability cr team 
data tase files and security code files. The purposes 
accomplished by this frocedure are: 

(1). File Availability. The error return codes 
tell ERCUJMNG EXEC wtether there are files available for use. 
Neither FROJMNG EXEC nor PRCJUNG FORTRAN can froceed withcut 
files fren which data can be read or to which data can be 
Wilt ten. 

(2). File Integrity. Having found a usakle 
DATAFILE cn the team disk, PROJMNG EXEC attempts to read the 
contents. It looks syecifically for the team number. The 
team number cues PRCJMNG EXEC not only as to what the tean 
Should be called, it also reveals the prior use of the 
PATAFILE te store data. 
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Eo) MOn2 tor ‘File 


In a Similar manner, PROJMNG EXEC determines the 
avabilability and validity of the monitor file “DATAINST 
DISKNUM". The presence of data in the file and the SEcurley 
field format within LATAINST DISKNUM tells PROJMNG if the 
disk gaining access toit belongs to a monitor. Cisks 
belonging tc monitors are not intended to be the disk which 
students access to run PROJMNG. 


c. DATAFIL£E Creation 


PROJMNG EXEC determines the team disk status. 
If DATAFILE and LATACCDE files are not found, PROJMNG EXEC 
proceeds tc determine the team number. It will ask "WHAT IS 
YOUR TEA¥Y NUMBER?" tefore it copies the files. After the 
team numrer is evaiuated for being in the range of 1 to 20, 
the program generates the "TEAMxXx" abel. It will accept 1 
to 20 with any number of preceding O's. The TEAMzx larel 
will iunclude ap to fcur numbers in the xx field. This latkel 
is used in the process of copving the dummy files. PRCJMNG 
copies the dummy files using the labels DATAFILE TEAMxx and 
DATACCDE TEAMxx as tke new file name and file type. 

In the eévent that more than 20 team files are 
required, FEROJMNG will accept team file labels with addi- 
tional leading zeroes. Teams with files labeled TEAMO1 and 
TEAMOO1 can both be created. 

The availability or the DATAFILES also gives 
FROJMNG EXEC the team number. GachJOn DALATILES ws synony= 
mous with no team number. The team number is determined 
cnly once during the course of the gameplay. It is PRCJMNG 
EXEC that makes that query. It forms the team number into 
the "xx" portion of tke files' type labels. PKOJMNG stacks 
the team number inte its virtual reader to enable PROJMNG 
FORTRAN to copy the team number. PROJMNG FORTRAN uses the 
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team numter to label displays and, when storing the data- 
base, filaces the numter at the head of the record. 2ti-us 
this storing process and filling in of the first DATAFILE 
field which later enables PROJMNG EXEC to find the tean 
number withcut additicnal queries. 





FRCJMNG EXEC completes determining if the disk 
rFelongs to a team or menitor, gets the team number or sets 
the mcnitcr's flag of team number 21 (FL21), insures the 
availability of write files or creates them, and then loads 
and starts FROJMNG FCRTRAN's text file. The team database 
Capability has been set for 20 teams. The data file for 
moniteors was chosen in excess of tne team database design 
suze OL 20). Having chosen TEAM21 to be the monitor's file 
label, it was convenient to utilize the label TEAM21 as a 
flag ktetween PROJMNG EXEC and PROJMNG FORTRAN. It indicates 
to ERCUMNG FORTRAN that the computer operator for _ the 
sessicn has been determined by PROJMNG EXEC to be a monitor. 
Upon termination of PROJMNG FORTRAN, PROJMNG EXEC again 
takes contrcl. Tf the operator 1S a Monitor, tne 2 xeC 
allows tke monitor to request the creation of a concatenated 
file cf allcurrent team files on the PROJMNG disk. FOL 
team disks, the exec sends a copy of the files DATAFILE and 
LCATACCDE to the master disk. This file transmissicn enables 
the mcnitor to deterzine team progress and to accept the DP 
decision rerforts. PKRCJMNG erases unnecessary residual files 
such as the LOAD MAF and then returns execution control to 
IINKEERCJ to perform the "ANOTHER KUN, Y/N?" query. The 
team's response to this question will either terminate the 


sessicn or reloop the program to the beginning of LINKPROJ. 
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Fe. DATAEASE CHANGE 


After data files have bteen created, PROJMNG uses the 
CATAFILES as a baseline of team information. Once the file 
is created the program assumes the data is accurate and 
Satisfactory for use in all subsequent sessions. All 
further Selection Menu displays will display tne OMS data 
items as they are currently found in the team's file 
Deena rILe TEAMNXx. 

At the beginning of the team's first session all of 
their data items must be submitted. A database is generated 
from which successive sessions will obtain their baseline cof 
information. The process of asking for all data items 
occurs through the prcgram's subroutine PAGEIN. 

The pages of the OMS decision sheets, Appendix E, list 
the data entries necessary for CNP. These same entries are 
gueried once in PSBCJMNG by PAGEIN as demonstrated in 
Appendix F. Each fpage of data gueried coincides with the 
Fage and the data item of the decision sheets. Availatle 
farameter ranges are listed with the item name in PAGEIN. 
Correct completion of a page of data permits the rerogran to 
check the data input for errors. If the program does not 
understand the Tipit, Or requires revisicn, a 
*eeXAWARNING*#*#*** Ys displayed and questions designed to 
correct the discrepancy are asked. T£ the data entered 
cannot be read by PRCJMNG the EXIT guery "DO YOU WISH TO 
CONTINUE: Y/N?" will occur. Teams experiencing corfusion, 
or wishing to exit tke program during PAGEIN, can do so by 
pressing <<ENTER>> without any input. Duting, (~PAGELN ths 
action will enable the teaz to use the exit query te stop 
the pfrogran. 

The autcmatic call to the PAGEIN routine occurs only 
when the DATAFILE contains 0's in all of the data base data 
fields. Successive sessions in PROJMNG by a team utilize 
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the datakase DATAFILE to fulfil the data field input func- 
EON « PAGEIN can be called at any time from the Selection 
Menu. This option permits the team to make mass changes to 
data items. 

Once the program has a set of data it will produce a 
table ccntaining those values, Table IV. The SELECTICN MENU 
gives a review c£ the current data values and acts asa 
selection menu for items the team wishes to change. 
SELECTICN MENU presentation is achieved by either corpletion 
of PAGEIN, ky beginning a subsequent session, by completion 
of a DP proposal submission, or by team choice from the AAIN 
MENU. 


| DC YCU WISH 70: 


| 1. RECEIVE THE TAEFIE OF ACHIEVED VALUES. 
#44 * SHARNING#****AF TER THE TENTH DP- 3 8 
AN ALILITIONAL DEVELOPMENT COST OF $100,0 
WILL ES INCURRED FOR EACH ADDITIONAL RON 
N 1 OCF YOUR DP- 3. 


Figure 3.1 MAIN MENU. 


Ge MENU 


Ccntinuing seguentially through an initial terztinal 
session with PROJMNG, the next feature which differentiates 
Gas pfrogramifrom CN’ is the MAIN MENU, Figure 3.1. From 
this routine in thé main progran, any of the opticns 
performed by PRCJMNG for the team can be executed. This 
menu places the PROJMNG FORTRAN program in the category of 


being a menu-driven progran. 





— << ee ee ei ce ce a ey ee ee ee es ee i ee a a 


TABLE IV 
DATABASE PRINTOUT as SELECTION MENU 
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The cptions available in the MAIN MENU are to print the 
table of achieved values, to return to the database table, 
to sukmit a proposal, or to exit. 

The achieved values Operon. GlECets the“ program to 
execute the routines associated with creating the 
Development Contract Summary table, Table VY. First the data 
entries for fee percentages are checked. The fee fercent- 
ages are added together and evaluated to determine if they 
total 15%. If they donot equal 15%, PROJMNG FCRTRAN 
requests corrections through a seguence which displays each 
current fee percentage value andasks for a value to be 
submitted. The program performs the computations for the 
table created in sukroutine FROSUM. Then the tacrle is 
displayed. Each time the computations are made the run is 
counted. After ten runs, the program adds a fee of $100,000 
onto the contract price for each subseguent run at that DP 
level. 

The seccnd option returns the display of the data table. 
It prcevides the team with the table, Selection Menu, of data 
items which are used for reference in changing data values. 

ies third Gapabiiity “fron the .“AIN MENU is proposal 
submissicn. Submission of proposals is discussed in the 
next section. 

To enakle the team to stop the program, the fcurth 
option in MAIN MENU allows them to exit. 


He. REPCHT SUBMISSION 


1. Exggress Repert 


Subgissicn of progress reports has been readily 
accomplished 1n PROJMNG EXEC. The process of completing 
FROJMNG EXEC when leaving PROJMNG FORTRAN serves to execute 


the cemmands for file transmission as discussed 
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MiesursSectiton 3.8. 4%. Zs The process of data file transtris- 
Sion to the PROJMNG disk provides those files for access by 
the mcnitor. In the monitor's session, all tean data files 
which have been sent to the PRCJMNG disk are copied onto the 
Monitor’s personal disk for read/write use. This feature 
was also discussed in 3.8.5. and is covered in greater 
detail in Chapter 4 with the discussion of monitor 
functions. 


2- Decision Subrission 


Submission of the team's decision occurs with the 
transnittal of the team files to the PROJMNG disk. Webi n 
the data ficeids transmitted, there is a label field which 
contains the status of the team's work on a given decision 
EOLaAt. This field is either blank, "00000000", "“"DPROPCSED" 
Bee FINAL". These labels are sequentially exclusive. They 
specify the exact status for the DP level of the set of 
database fields in which they are contained. Each DF level 
Fas fcour lines of cata in the DATAFILE TEAMxx. The DP 
status label is the last field of data in a set of lines. 

The DP field labels are assigned in the FINISH 
subroutine. By accepting the values in the table of 
rroposed values for the contract proposal, Proposed Values 
Table (Table VI), or of proposed final values as the final 
approved contract, Final Contract Values Table (Table VII), 
the team causes the label to be written. These labels cccur 
only when the team enters its security code to validate the 
proposed values. Conrpletion of the value assignments tc the 
database for transmittal appears with the table of accepted 
values, Table VIII . 

The label is written as the last field in each cf DP 
level database records. These labels can be seen in the 33rd 
field of each set of four lines of a DP data, Table Ix. 
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TABLE VI 
Proposed Values Table 
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TABLE VII 
Final Contract Values Table 
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TABLE VIII 
Accepted Values Table 
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sPRESS <<ENTER>> TO CONTINUE. 
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Cse of the security code in this feature was 
designed for ‘human factor’ engineering. Toe conscicus 
process cf entering the team's security code indicates the 
user's delikerate entry of the data. Inadvertent accertance 
of the datakase for the team's position cannot occur. 

The team does retain the responsibility for reading 
and understanding the data displayed in the tabie of data, 
Table VII. 

The process of the team submitting a final ccntract 
proposal provides the program with the position agreed to 
during contract negotiations. Submission of the finral 
report indicates to the program that the team has completed 
a DP level. PROJMNG assumes the team is ready to preceed to 
the next DF level, for example DP-4. It utilizes the 
previous DP level data entries from the submitted final 
report and prepares the new DP data table. The team is 
sequenced tc the next higher level whenever a final proposal 


is detected for a given DP level. 


Ie CALCULATION CORRECTION 


As discussed in Chapter 2 several of the coaputaticns 
which were designed for CNP to accomplish were not satisfac- 
tory. Conseguently tteir disrlay was suppressed. 

In PROJMNG these calculations have been reformulated. 
Their algorithm is tased on the linear extrapolation ofa 
fee over the range of its alloted parameter values. The 


contract cost for the fee incentive is calculated by: 


1. Assume achieving optinum performance results in total 
fee payment. 
2. Assume achieving the worst performance expected 


results in no fee payment. 
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3. Determine the ratio of satisfactory achievement; the 
difference between the achieved value and the worst 
value expected divided by the range of value kLetween 
worst and optinun values expected. 

4, Multiply the ratio determined by the maxinun fee 
percentage offered for the incentive. 

5. Multiply the resulting percentage by the target 
development ccst, the average value of the maxinun 


and finimum desired develofment cost. 


The following equation is used in PROJMNG to determine 


fee ratio. 
FEERATIO=FEEMA X* (aks (WORST-ACHIEVED))/(RANGE) (eqn 3.1) 


This formulation for fee costs has proven tc tke mere 
Satisfactory than that of CNP. 

The dafficulty in CNP arises from numerical manirpula- 
Lon . Farameters in CNP frequently have their power-cf-ten 
changed to fermit caiculaticns at different resource ztulti- 
ples. This is particularly true in the case of achieved 
development cost. Frequent multiplication by 1,000,000 with 
division Ey 1,000,000 to return the dollar values to 
millicns cf dollars incurs computer roundorf. The roundoff 
errors when repeated several times become sufficiently large 
to be apparent in the ratio calculations. 

PROJMNG does not use the numbers which the computer used 
in computing achieved value resources to determine the fee 
values. Its numbers are taken directly from the database 
acray, and are only mathematically manipulated by this cne 
calculation. This frocess results in only one iteraticn of 


moundcitf error. 
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PROJMNG is not able to eliminate computer roundcff 
SELOr, but the ercundoff effect has been significantly 


reduced. 


Je SUMMARY 


PROJMNG'sS design has its foundation in CNP's routines which 
were designed arcund (PMS. It uses this foundation from CNP, 
and develops an extended progran. The program extension uses 
the current IBM-3033 facilities to drive user-directed 
options in a manner which provides the team contrcl over 
Program execution for completion of the DMS exercise. These 
features for team use of PRCJMNG make PROJMNG easier tc use 
in analyzing team positions. Chapter 4 discusses the anal- 
ysiS cafabilities of PROJMNG which are available to the 


Monitcr. 


(fi 
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IV. PHCJMNNG MONITOR OPERATION 


A. CHE MNCNITOR UNIQUE FUNCTIONS 

CNP has one routine capable of providing support tc the 
Monitcr for his evaluations of the scenario progress. This 
Singular routine is net available to the teams. The nonitor 
can access the COST + FACTORS Table, Table X as discussed in 
the previous charter. Access to the monitor routine cccurs 
Ey the ccmputer cperator's resrfonse to tne query for "CCST + 
PAGTORS 28. This response is coded to provide security of 
the COST + FACTORS table from team access. En “Order to 
preserve its integrity, the security code will not Le given 
or demonstrated here. Correct security code responses to 
koth the first "COST + FACTORS ?" and a second query of 
MGOST + FACTORS 7?" are necessary. The first response is a 
three character code word. The second guery response is 
rased on a data field used in the computations which has 
already teen entered for the session. it constitutes ma 


variarle security code. 


inc hey an additional mecnitor capability is provided 
through the confirmation query, NCONFERA Ss, at the ODP 
number verification sequence, "Is THIS DP NUMBER ** 


me. =-fE&S CR “NVENC 2? . Response to this query witha 
fixed single letter, places the operator in the "INSTRUCTCR" 
mode. Analysis cf the program's Fortran code indicates that 
the INSTRUCTOR mode simply suppresses the queries for 
confirmation and the repeat back display of input data. 
Answering the statements "IS THIS DP NUMBER ** xx;"Y¥"=YES OR 
MNVSNC 2" with a "I" reduces the displayed querie€s. pas 
eliminates the repeated displays of "RECEIVED ...2.202 XXXXX; 
CONFIRM 7". It also eliminates the repeat back printout of 


input page data. 
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COST + FACTORS 
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309.906 
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ea on ACHIEVED 


MPONENT TABLE BOW FACTOR ACHIEVED 
MOTOE: 
1 25 O28 2Z5 
0.877 
AIR FRAME: 
2 0.956 
Q0.9€ 
GUIDANCE A: 
5 - 6€E 
0.630 
GUIDANCE E: 
6 ~5&C 
FIRE CONTROL: 
16.00 84S 
G5302 
LAUNCHER: 
3 720 963 
. $88 
| | 
eee eer 


The loss of page data repeat back and confirmaticn, and 
the fcrmat of Table X have not been appealing to users of 
the fprogran. The "T" letter code system was not human 
factor engineered. Loss ot the data item confirmation 
sequence increases tke occasions when inaccurate results are 
received in the Develcpment Centract Summary Table. Users 





have nct found benefit in these options. Additional exrperi- 
ence with CNP is necessary to use these features success- 
fully. Consequently, use of the "T" feature has not been 
used. The COST + FACTORS table has been found to ke less 


than adequate. 


Be FRCJENG MONITOR UNIQUE FUNCTIONS 


In PROJMNG a variety of options are available for the 


Womrtcr. They include: 


1. Mcnitor Unique Security Systen 

2. Query Suppression for the Monitor 

3. Mcnitor's MAIN MEND 

4. File Access Oftions 

Bee Col + FACTORS 

6. Sensitivity Analysis 

7. Graphing 

Se Copies of Student Files 

This chapter will LCeview the intended capability and 

operation of these mcnitor unigue functions. 


C. SMCNITOR UNIQUE SECURITY SYSTEM 


The PRCUJMNG EXEC routine looks through the ccnmfuter 
@eerator'’s disk for a file titled "DATAINST DISKNOM". 
Hayvang lccated this file, the computer assumes that the 
cperatcr iS a monitor, and proceeds to validate the monitor 
identity. The program contains three file checks to deter- 
Mine if the operator is a monitor. Unsuccessful completion 
of the first two checks will cause the computer tc ignecre 
the LATAINST DISKNUM file and assume the computer user is a 


student. 
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Phe z1Est Of these checks is the file format. ih Saye e 
first line must contain the userid. The second line mest 
contain a monitcr specified security code. This mcnitor 
security code is quéried in the same manner in which the 
team security code is gueried for a team disk. 

The third verification is a check of the stored monitor 
security code against the individual's ability to repreduce 
that code. A code match allows the program to proceed. 
Failure to accurately match the code causes the frecgran to 
stop. FROJMNG EXEC takes control to finish its executicn. 
The user can reaccess PROJMNG FORTRAN in his response to 
Weer kiEs RUN, "Y'/ tN? 28, 


D. QUERY SUPPRESSION FOR THE MONITOR 


Successfully accessing the progran as a mcnritor 
suppresses the student's Main Menu, discussed in chapter 3. 
Conseguently, the mcnitor does not receive the student's 
Main Menu after each alteration of the Selection Menu. 
Based on the assumption that the computer operatcr is a 
monitcr the program immediately follows the Selection Menu 
with the Developszent Contract Summary, Table XI. 

Takle XI demonstrates the display seguence for the 
Selection Menu with the execution of option "Q", The moni- 
tor's response to the Selection Menu with a zero causes the 
immediate execution of the achieved value calculations. 
Cther selections from this table are performed similarly to 
those dene for the team. The changes entered by the monitor 
in this first mode will not be stored in the database by the 
program. In monitor mode 1, the call to the routine STORE 
does not occur. Only the array of data in the disk's buffer 
will be altered. The monitor sees the computer response to 
mes cntry of a “Q" as an immediate display of the 


Develcrmnent Contract Summary. 
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E. MCNITOR'S MAIN MENU 

The PRCJMNG monitor's MAIN MENO contains options to 
allow the monitor access to any of the routines in the 
Frogran. It has a wnigue feature in its flexible:length. 


This feature provides menu listings to the monitor which are 


determined Ly his status in the program. If the monitor has 


just entered PROJMNG or has changed the team number, and has 


not ccmpleted the comrputaticns for other display values, the 


prograr will suppress those cptions from the menu disflay. 


Options which require calculations or seiections which have 


not been processed for the team are assumed tc present 


results which are either not applicable or misleading. 


| | 
MAIN MENU? 
1. CHANGE TEAM NOMBER 
Za CPE OUe Shee er ton QUERY 
Boe HE Nee so Pore oN Menu | 
4. REAUN THE DATA CALCULATION [ 
| Se UOLA -cEN SLI LV PE ANALYS ES 
Sse oi tOuUT COST EPNCTORS 
fig oa yst | 
Pigure 4.1 Monitor's Main Menu. 


paguce Got, 


demonstrates the baSic monitor's 


Main Menu. 


1. Change Team Number 


Cption 1 when selected will return the sonitcr to 


The execution of 


The 


the program's team input routine (TEAMIN). 


this routine begins ry displaying a menu, Figure 4.2. 


selecticns cn thiS menu are; 


Shs, 





se lrCl WRiChR INSTRUCTOR MODE YOU DESIRE. 
1. RUN TEAM SCENARIOS WHICH ARE ON THE MONITOR'S DISK. 
Bee CuANG Pali Ann Eke oe 
Dalomioos. Witte LER THR) STUDENT'S FILES. 
a Ne OMwielon Cs TEAM Fiin *TEANZ1* . 


Figure 4.2 Monitor Mode Menu. 


a. Run Team Scenarios from the PROJMNG Disk 


Selecting this choice enables the monitcr tc run 
€valuaticns and displays of the teams whose DATAFILEs have 
keen written on the PROJMNG disk. PROJMNG has at this foint 
already written these files to the individual monitor's disk 
for use. As the mecnitor selects a team to review, the 
program determines if the team file exists. If the file 
exists, the monitor may proceed with the evaluation. If no 
files exist for the team requested, PROJMNG responds with 
Berens JC NCT EXIST FCR TEAMxx', and proceeds to ask fora 
different team number, ‘WHAT TEAM NUMBER ?*, until a teéean 
bumber is submitted for which files are present. 

This opticn selects a node of operation in which 
team data files are not changed by the monitor. The menus 
displayed are only those associated with the renitor's 
cpticns. The Monitcr's Main Menus are flexible menus. the 
discussion of this flexibility and of the basic menu will be 
Frovided in the follcwing sé€ctions o£ this chapter. These 
differences are demcnstrated by the two monitor menu 


displays fer mode 1, Figure 4.3, and for mode 2, Figure 4.4 
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MAIN MENU: 

1. CHANGE TEAM NUMBER | 
Zee tae e Shoe CLUCN OUERRY { 
3. THE INPUT SELECTION MEND | 
4. RERON THE DATA CALCULATION 

- CO A SENSITIVITY ANALYSIS | 

« PRINTCUT COSTt+tFACTORS 

=) CALL 


Pigure 4.3 MAIN MENU in Mode 1. 


(as 
MAIN MENO: | 
1. CHANGE TEAM NUMBER 
Zot babe ee LEC lLION OUER ¥ 

| Saemelik INPUD SELECTION MENU { 
4. RERUN THE DATA CALCULATION 
a LOMA RCONGLILVI TY ANALYSES 
Oa ERUN TOUS COSTEPACTORS 
7. FILE TEAM PROFCSAL 
een EX nT 

-— © 


Figure 4.4 MAIN MENU in Mode 2. 


bk. Change Team Files 


Option 2 has an entirely different affect on the 
database. Again, the files accessed are those previously in 
existence. The monitcr receives a different version of the 
MAIN MENU, The added option in this menu, Tian Pee ea 
PROPOSAL" permits the monitor to change the DP refort level 
for any cf the team's DPs irregardless of the team's current 
level. 

The monitcr can perforn all of the functions he 
could in mode 1 plus changing the report level and placing 


these selections in the team database. This aode should orly 
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Fe used to correct team errors. Team database manifulation 
for any cther reason will lead to team confusion. 

The query which finalizes the replacement of the 
team database, "SHOULD THE REWRITTEN TEAM xx FILE BS SENT TO 
THE ERCJMNG disk: Y/N ?". Unless this query is answered in 
the affarmative, the mode 2 capability to overwrite the tean 
file is not performed. 

Answering yes to the guery to rewrite the team 
file directs PROJMNG through a routine which performs three 
calls to the subroutine FRICMS which permits CMS executive 
level commands to be executed from within a Fortran progran. 
The three ccmmands in this routine are the same as the spool 
commands in PROJMNG EXEC which send the file DATAFILE TEAMxx 
to the PROJMNG disk. The disk punch file is spooled asa 
class x file. The DATAFILE TEAMxx is punched into the srcocl. 
Finally the spool is closed and sent to the PROJHNG disk. 

The program does allow the DATAFILEs on the 
monitcr's personal disk to be rewritten whenever mode 2 
operation is selected. Transmission of these files tc the 
Master PROJMNG disk can be accompiished after respondirg in 
the negative to the guery "SHOULD THE REWRITTEN TEAM xx FILE 
PFE SENT TO THE PROUMNG disk: Y/N ?". Sending these files to 
the master disk must bea deliberate act of the mscnitcr. 
The mecnitor may either use one of the macro routines in 
general usage on the IBM-3033 for sending files between 
users, "SENI". Or, he may sfool the files for immediate read 
Ey the EFROJMNG file using the following sequence of stefs. 
{ The lower case characters in the following command demcn- 


stration are optional inputs. ) 


1. “SEocl PUNch CCNT CLass X 0276P" 

2. "“EUNch DATAFIILE TEAM (XX)", where xx is the two digit 
team number. 

ae “"SPoclL PUNcCh CLOSE NOCCNT” 


2) 7 





In mode 1 or amede 2 operation, only the 
Tevelopment Contract Summary table resembles the sane 


display for the teams. 
ce. Run the monitor's team file "TEAM21" 


The third ocpticn provides a team file for the 
monitor. TEAM21 is the monitor's own team file to siaulate 
the team interaction with the progran. Tnis provides a 


scratch fad file ror the monitor's use. 


d. EXIT 


Option 4 from the ponitor's Main Menu stops the 
program. Entering a ‘4" in response to this menu directs the 
Enogran tc stop. FROJMGN EXEC resumes control of the 


computer precessing. 


ze The DP Selection Query 


Number 2 on the menitor‘s mode nenu reloops’ the 
program to the DP guery for which DP the monitor desires to 
evaluate. This query will not prevent the monitor fron 
accessing DEF levels for which the teams have not submitted 
files. The level which the team has completed is displayed 
on the Selection Menu, with the DP query, and on the 
proposed rerfort table. This information should be known by 


the monitor based on the progress of the DMS scenaric. 
3. The Input Selection Menu 


Again, the menu routine simply reloops the prcgran 
executicn to a previcusly executed question to pernit the 
monitcr to change his mode of analysis. In this case he 
returns to the team Selection Menu. The last team and DP 
inputs entered during the monitor's session will apply to 


the team database which is displayed. 
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Charges to a team's list of data in the oprcegran 
kuffer which have Leen entered during a session remain 
applicabie until the team number is changed. Any variations 
to the Selection Menu which have been selected for the tean 
currently being evaluated will be in effect. In mode one, a 
team's data will revert to the PROJMNG disk's team datafile 
values when changing team numbers. Mode 2 will keer the 
changed values until the PROJMNG disk values are reccpied 
down cnto the monitor's disk. 


4. Rerun the Data Caiculation 
This option causeS PROJMNG to redo the achieved 
value calculations. The display for this selection isa 


repeat of the Develogment Cost Summary. 


This option creates a major option for exploration 
Eye the menitor. It is discussed as part of the sequential 
demonstraticn of the monitor functions which fcllows in 


Secticn I below. 


6. Frintout Cost 


1+ 
rid 


actors 


Similar to the capability for COST + FACTORS demcn- 
Strated Ey CNP, PRCJMNG has an equivalent feature for the 
monitcr. Table XII shows the improved layout of the data. 
The table has the benefit over CNP's version Ey not 
requiring a separate code to access it. The table is simply 


accessed as a menu selection from the monitor's Main Menu. 
ree EXIT 


This is another example of PROJMNG'S ability to stop 


the [Erogran. 
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TABLE XII 


— © Tn 
| 


COST + FACTORS 


_ ane =) on =) 22 ee 2a em CH PP “Ea CEP SP ES 22a eo oe —b ap a D> eee eer SP EP ee ese ee ee es es ee es ee ee ee ce 


COSTS OF TESTS PER UNIT (IN THOUSANDS OF DOLLARS) 
oe eter te eS LS 





{ 
ALR FRAME 3 126.355 
GUIDANCE : 309.906 
FIRE CONTROL 3; 33°56 106 
WAUNCH EK s ee ee 
Peroni lero lS 3 Sawer oust: | 
BeSIGN MACTORS ACHIEVED | 
CCMPONENT TABLE &OW FACTOR ACHIEVED 
UOWOR <s 1 23 0.525 O07 | 
Ale FRAME 2: 15 Ves chs fe 0.980 | 
GUIDANCE A :; 5 22 0.666 0.030 
GUIDANCE B ¢ 6 25 0.580 0.0 | 
FIREVCONTAOL ~y 16 0.845 Dra 0'Z 
LAUNCHER 3: S 7 0. 936 O2203 | 
ITHCOO1A EAUSE ;PRESS <<ENTERD>> TO CONTINUE. { 


8. Flexible Menu 


The options fresented in this section are the fEasic 
caparilities of PROJMNG. However, additional capatilities 
become fossible as the evaluation progresses. With the 
compieticn of the sensitivity analysis additional tatrles and 
graphs are within the capability of PROJMNG. These flexitle 
menu capabilities are explained and demonstrated in Section 
I of this chapter. 


Fo MCNITIOR SESSION FROCEDURES 


The remainder cf the discussion on menus will be 
presented sequentially in the following sections. Their 
relative position in the textual sequence corresfonds to 
their cccurrence in the process of stepping through the 


Frogram's rcutines. 





These sequential steps of PROJMNG are demonstrated as 
the program would be operated. The material in this déemcn- 
stration is preliminary to the preparation of an instruc- 
tor's manual. (The sections are: 


me Initialization 
2- Basic routines of the Main Menu 
3. Sensitivity analysis 


4. Logoff unigue routines 


Ge. IRITIALIZATION 


1. PROJMNG EXEC Cperation 


SS — are? = aa A FS ——_ = Se 2 SS 


The monitor's access to the PROJMNG package of 
programs 1S also acccuplished by LINKPROJ. The determination 
that the disk accessing PROJMNG 1S a Monitor is made, as 
discussed in Chapter 3. Having completed the checks cf the 
Monitor's file DATAINST DISKNUM, the PROJMNG EXEC progran 
conducts a check of files for a DATAFILE TEAM21. This file 
must re present on the monitor's disk if he is going te use 
itn PHOJMNG. PRCJMNG EXEC either finds the file or 
creates cne in order to have the file ready for PRCJMNG 
FORTRAN's read and write lnstructions. 


2. Available Files 


The lack of fresence of the files which PROJMNG EXEC 
feoks for is an autcmatic function of the IBM-3033. This 
capability was retained to display to the monitor a list of 
teams from which he has not received reports, as Shown in 
Figure 4.5 Offsetting of the display from the left margin 
was perforzed in order to highlight between the computer 


printout and the typed queries. 
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A benefit of the "PRESS <<ENTER>>" set of statements 
is the abkility to fregin a display ona fresh screen. 
Displays which should apfear aS one screen occur acre 
readily when the pause has finished the previous display to 
keep it disflayed while the user is reading it. The pause 
can Fre followed by an immediate command in FRTCNS to 
"CLRSCEN ', clear the screen. This sequence of comzands 
leaves a fresh screen for the next screen display. The 
first lire that PROJMNG prints out appears as the tof line 
of a display (see Figure 4.7). 

Cueing the user to fpress <<ENTER>> identifies a 
Fause which has beer placed in order to organize screen 
displays. The pause in Figure 4.5 enables the display of the 
teams ‘not found' to kre isolated on one display. There can 
ke up to 21 teams displayed, as for example at the start of 
an exercise scenario. Without the pause to segregate the 
displays, all 21 teams would not appear on one screen. The 
Single screen full of one type of data aids in user ability 
to study and analyze the data. Splitting the display toa 
second view eliminates the first screen's data and taxes the 
user's recall to do any ccmparisons. Isolating the data 
onto one screen elinzinates these disruptions to the user's 
Study of the data. This technigue of segregating related 
informaticn onto a screen has been used throughout this 


Frogran. 


3. Furging DATAFILEsS 


In crder to frovide a convenient method of purging 
files frem the completed exercises, a routine was generated 
which permits the mcnitor to purge all of the existing 
files, to conduct nermal operation of the program cr to 
exit. These options are depicted in the display as Shown in 
Figure or The purge option purges only the available ‘A’ 
disk DATAFILE TEAMxx and DATACODE TEAMxx. Should the 
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BEGIN RECORDING OF TERMINAL SESSION 
* NOTE!: YOU ARE NCW LINKED TO PROJMNG 
ON OUR 192 500Sh 7 NODE Cc 
SONO UES SO ER ESS PFCOS TC BREAK THe LINK 
PRESS <<ENTER>> WHEN YOU ARE READY TO CONTINUE. 
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*OOeeF.. 22. EXECUTICN IS IN FROGRESS 
WALT. POC NCT PRESS ENTER. O4*e ot 
Perm DATAPITLE TEANZ7 A* NCI FOUND. 
feemre  PATAPILE TEAMI1 C* NCT EFOUND. 
Peo UALTAFILE TEANIZ C* NCI FOUND. 
Mere" LATAPILE TEAMI3 C* NCT FOUND. 
mer  PATAPILE TEAMIS C* NOT FOUND. 
Melee DATArTILE TEAMIS C* NCI FOUND. 
Beebe *DATAFILE TE2¥16 C* NCI FOUND. 
Mee DATAFELE TEAMI7 Ct NCI FCUND. 
Peete DAIAFELE TEAMIS C* NCI FOUND. | 
Peele PATAFTILE TEANTO9 C* NCT FOUND. 
fern  *DATAPE EE TEANZ0 C* NCT FOUND. 
a | 


Figure 4.5 Initial Monitor Display. 


FROJMNG EXEC purge function be performed on the FRCJMNG 
FORTRAN's disk the entire exercise scenario would be elizi- 
mated. cCnly database files pre-existing on team files or 
moniter's files could te reaccessed for PROJMNG. With a new 
play cf the exercise, it 1s expected tnat a new group of 
teams will be accessing PROJMNG. No conflict with fcrzer 
team databases should be experienced once the monitor's and 
the PRCJMNG's disks have been purged. 

Normal operation initiates PROJMNG FORTRAN execu- 
EO lt. The standard procedure during a game exercise is 
designed to respond to this guery with an "N", The word 
length difference between FURGE and N has been designed to 
make inadvertent destruction of the team files more 
cee hicult. 

"E" again provides a means of stopping the precgran. 
In this instance, "EE" will stop PROJMNG EXEC and return the 
computer to running the LINKPROJ program. The final display 
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of LINKPROJ, "ANOTHER RUN, "‘Y* OR "N'?", would be the query 
following the request to stcp. 

"WAIT FOR EXECUTION TO BEGIN" became a necessary 
printcut as the result of long waits for execution to tegin 
Sm the NPS IBM—3033. (One monitor reported experiencing a 
20 minute delay during very heavy use of the comguter 
facility, with the "WAIT FOR EXECUTION..." label reminding 
him that the program was in the queue to be run.) 


—-_ |... | 
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K*¥*KKANSHERING *' PURGES TO THE FOLLOWING ae WILL **¥¥**% 
**¥*x**PURGE ALL EXISTING STUDENT DATAFILES * *** xx 
*EeX**ON THE DISK YOU ARE USING. ** **% 
DOeVOUP WL OHIO TNETPALIZE ALL TEAM FILES 
ECh A NEW ERS EXERCISE? 
"PURGE =PURGE ALL TEAM DATAFILES 
"N'=PROCEED WITH NORMAL OPERATION 
"Et =STOF 
==>==)N 
WAST PORSUVESECUILONG T Ore EGIN", 
PeECUITCN BEGINS. ..« | 
Re 


Figure 4.6 Mcnitor Session File Purge Option. 


These initial queries, printouts and displays by 
PROJMNG in the monitcr mode of operation should appear to 
the reader as very sinilar to those presented to the teams. 
It sheculd also ve recticed in Figure 4.7 that the precgran 
does not ask for a t€am security code input to create the 
team's cede. Instead, it has already received the mcnitor's 
security code from FROJMNG EXEC. The monitor's code is 
found by PRCJMNG FORTRAN in DATAINST DISKNUM. 


He EASIC PROGRAM ROUTINES 


The rogram routines discussed in this section perform 


similar frocesses in toth CNP and PROJMNG. 
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ineeobart Of PRODGENG'S Run 


The stacked data items are read by PROJMNG as its 


first step in the routine for team number input "TEAMIN". 


op aa ae Ad 


MM KH KK KH KKK RK KKK KKK KS iiitegia eal 


TO TERMINATE THE PRCGRAM AT ANY POINT, 
Peat eg eer el Ror Ou mh LO RNY ny ES7 NOt UERY. 
KKRARAKK HGH EKER KARE KEE SEK KEKE RARER EK AKA EERE REESE | 
Tent PONS SSIN RESPONS® TO A QUERY, PRESSING, <<ENTERD> | 


WITHOCOT PROVIDING DATA WILL DUM? THE PROGRAM. 
EY ORAERE AEE ER AE REESE EEE EE EEE EEE FERRE AES TRS EEA AR EAE 


SLEASE ENTER YOUR SECURITY CODE. 


Figure 4.7 PROJMNG Initial Dis meas 
Having received the FL21 filag os Ff 








i pen Rn te a 


and vali- 
dated the mecnitor's security code, PROJMNG can proceed. 38 
the security code shculd be entered incorrectly, the PRCJMNG 
executicn is terminated. The monitor receives a warning of 
the Error, and is asked to reinitiate his startup of the 
program. He may either answer 'Y¥' to "ANOTHER RUN, ‘'Y* OR 
'N' 2?" or reenter "LINKPROJ" after PROJMNG EXEC and LINKPiOJd 
EXEC have finished execution. 

FROUMNG FORTRAN asks for the team number when a 
monitor is running the program. Team selection withir the 
program is necessary in order to permit the evaluation of 
more than one team. Whereas a team will only enter the 
program with one team scenario to perrora, the monitcr is 
able to change teams without reinitiating the progran. 

Figure 4.8 demonstrates the response given by 
EROJMNG when it cannot find files for the team numter 
requested in either cptions 14 or 2 of the monitor's Main 


Menu. The read cue '?' indicates to the operator that an 
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input is expected. In the operations demonstrated throughcut 
this thesis '====>" indicates the user input in response to 
the FRCJMNG queries. Figure 4.8 also presents a case in 
which tke frogram does find the requested files and proceeds 
to query the menitcr for which DP level he desires to 
evaluate. 


<> ee Se ee es Se i a D - : S e-ee e e 


Kist BGR WEE AM 22 


WHAT DECISICN POINT DO YOU WISH TO ANALYZE? 


=—===> - 


Figure 4.8 Team Number Responses. 
The queries illustrated in Figure 4.3 complete the 


functions cf the program routine TEAMIN. The program returns 
to the main program text and enters tne SELECT routine which 
displays the Selecticn Menu as it did for the teams, fTatrle 
XIII. Table XIII functions the same as before except that 
the entries are not stored in the team's database file. the 
Changes are made orly to the monitor's disk data tLuffer 
arrays. In option 2 cf the monitor's main menu, the changes 
are alsc stcred on the monitor's copy of the team files in 
his file listing. These changes are not applied tec the 
PROJMNG disk files urless the monitor specifically sends the 
changed files to that disk. 

In response to option "0 in Table XIII PRCJMNG 
immediately completes the calculation of fee percentages in 
the program routine FRCTCK. Successful completion of the 
percentage check is followed with, “che “calcwlatien “ct 
achieved values. This process occurs with the program calls 
to the reutines: 
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TABLE XIII 
Selection Menu 
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10. 


17. 


ZEW - sets all non-database variables used in the 
CeGleuca G1 ONS te Zerg . 


INPUT3 - reads the data tables in files FTI17F001, 


FII8F001, FTISFO01 and FT20F001 


PRESET - uses the database values to make initial 


adjustments tec the achieved value indices 

TRADE - evaluates the team's input tradeorfs and uses 
them to generate affects which to apply in calcu- 
lating the achieved value indices 

DESRES - degrades the performance factors k;ased on 
Tequests for system test. 

DESRET - degrades the performance for the effects of 
selected engineering values and performs the calcula- 
tions for production costs. (This feature, preduc- 


tion cost computation, was not used in CNP and has 
not keen activated in PROJMNG. ) 
SE - applies resource parameters to the achieved 


value calculations. 

pep scoubines ~the calculation results from the 
previous three routines to derive a total cost factor 
fer develcpment. 

RERUN - selectively sets recursive variables to zero 
tc enable the rogram to finish the calculaticns of 
one DP and to reloop to compute the values for 
successive DP's 

REPORT - completes the calculations after all DP 
level comrutaticns have been completed. 

PHCSUM - performs conversion of the achieved values 
to the appropriate power of ten for display tec the 
user and generates the display, Table XIiv. 





2e summary of Basic Capabilitie 





Io this point, the kasic capabilities of PRCJMNG 
which it has in commen with CNP have been discussed. The 
improved displays, access and’ queries discussed farallel 
those features given to the students, with exception of 
student access to COST + FACTCRS. In the next section, the 
‘flexible menu! feattre of the monitor's main menu, and the 
associated capabilities for sensitivity analysis, for data 


displays, and for analysis graphing are described. 


Is SENSITIVITY ANALYSIS ROGTINES 
1. Sensitivity Analysis Basic Menu Options 


Figure 4.9 shcws again the monitor's menu in mocde 1 
operaticn fcr comparison to the expanded menu which is now 
@escriked. In order to accomplish the calculaticn cf a 
sensitivity analysis, option 5 from the menu is selected. 
In performing this selection, a flag is set ‘on' to indicate 
the availability of values for use in the other disrlays of 
the €xpanded menu opticns. 


MAIN MENU: 

1. CHANGE TEAM NUMBER 

Zorn VE SB LEC LION OUSRY 

Jee lhe INSU soe b CITLON AE NU 
4. REBUN THE DATA CALCULATION 
S« DO A SENSEITVITY ANALYSIS 
S- Boe eo COST+FaCTOrsS 


Figure 4.9 Monitor's Main Menu. 
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selection of number 5 from the menu ianediately 
accesses the progrars routine SNSITIV. Thas- subrcutine 
Frovides a selection mgenu (Table XV), gueries parameters and 
Farameter data for variaticn in the analysis, edits the 
parameter data to remain within DMS scenario linitations, 
divides the variable parameter into 10 steps for 11 levels 
of evaluation, rcuns eleven cycles through the achieved 
values calculations, displays the table of achieved values 
at each level, and stores these values in an array fcr later 
use in redisplaying the table and for piotting the comfuta- 
tions. 

Fcellowing the display cf Table XV, the nonitor makes 
a selection of which [MS data item to analyze. His selection 
determines a series cf questions which PROJMNG displays in 
order to resolve the analysis farameter details. Figure 4.10 
shows cne of these queries. In this case the Flight Tests 
will bre varied. The maximum and minimum values permitted 
are displayed with tke queries for range values. These are 
not cnly cues to the user but also are the limitations which 
FROJMNG imecses. 

If the selection exceeds the scenario design lizits, 
FROJUMNG will take one of two actions. In the first case, 
FROJMNG will reset the value to be within the range 


i) 
it 
it 
it 
V 
| 


A 


tr 2 


men 
HC 
t3 
Wri 
eo) 


lH 


EoeleOggves 
a VALU 


@ 
rs 34 

vr 
tJ 
try 
Ca) 
4 
tA 
og 
ty 
Hj 
= 
hy 
iz | 
<= 
e 


LUES 
LOWER 


JVatO- vSiH 
Hb 
Se 
by <j 


Conte S Lak. UP Peay ALUE: <25.. ? 


it 
tt 
i) 
it 
Vv 
aah 


UI 
ti 
i 
it 
Vv 
N) 
nn 
| 
ere ed 


Figure 4.10 Flight Tests Demonstration. 
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permitted. If the second case occurs, the user will be 
requeried fcr input. This occurs when PROJMNG doesn't under- 


stand the limits requested. 


2s sensitivity Analysis Table 


The Sensitivity Table, Table XVI provides a sinfle 
column display of the achieved values computed at each step 
of the analysis as a function of the related parameters. the 
Steps are labeled in the iefthand column. The second cclunn 
lists the value of the selécted parameter for the step. 
Some of the parameters wiil result in duplicate stefs. 
FROJMNG divides the range of the parameter values by 10 
which can result in a fraction. In creating a step for the 
table, the parameter value can be successively rounded to 
the same value. PRCUMNG 1s telling the monitor, 1t has 
recognized the parameter aS requiring an integer value. It 
has provided the closest integer to the value. The duplica- 
tion 1S the occurrence of the closest integer as the same 
number on successive cccasions. The first occaSion PRCJMNG 
rounded up to the value and on the second occasion it rcunds 
down. 

The remaining columns, except £1, are self explana- 
tory. They correlate with the achieved values data given in 
the takle of Development Contract Summary, Table XIV. EI is 
explained later in this section. 

Upen completicn of the table, PROJMNG displays the 
emerof "IHCOQO1A PAUSE ;PRESS <<ENTER>> TO CONTINUE". This 
holds the display for review by the gwonitor and reminds the 


monitcr cf the acticn to perfcrm arter reviewing the tarle. 
3. Menu Expansicn 


a> Sp as ll een GE 


FressSing <<ENTIER>> causes the program to ccntinue. 


The sequential routing of PROJMNG returns the monitor's MAIN 
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MENU display in the main program. Figure 4.11 demonstrates 
the flexible menu with the new options. These options are 


discussed as we proceed further into PROJMNG. 
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weil. Use Cpe uwerta VALUEOPROM LAST SENSTIVITY 
ANAL Yor CR DP=s PALA. | 
12. here 
| 
= a ee | 
Figure 4.11 Monitor's Main Menu in Mode 1. 


Number 7 on the menu returns to the last display of 
the Sensitivity Table viewed. PROJMNG's subroutine SNSITIV 
1s reentered through acall (entry) at the end of the 
subrowutire, ENTRY SNSPRT (enter SNSITIV and print the 
table). SNSITIV's array of stored values enables PRCJMNG to 
reprint the table without any calculations. 


The second new feature available through the main 
menu is the capability to graph the table results. The 
stored values in the array are passed to the PLTSCH sufrou- 
tine in a data buffer, COMMCN FLOTVA. The graph is 20 lines 
high and fills the entire screen. Consequently a fause 
statement at the bottcm of the graph could not appear on the 


same screen with the display. 
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In crder to alleviate this difficulty the cause has 
been eliminated. The display appears on one screen with the 
addition of a blank line which forces the IBM to holéd the 
display under the condition of a screen overflow, as indi- 
cated by the "MORE" in the screen lower right corner. The 
screen can be held only tempcrarily in this IBM display 
mode. if the operatcr desires to extend the hold fcr closer 
analysis of the grafh, pressing <<ENTER>> will change the 
IBM display mode to "HOLDING" which can remain indefinitely. 
Once tke operator has finished with the "MORE" display sode, 
ocr the "HCLDING" mcde he can continue by clearing the 
screen. Cn the IBM :278 this is accomplished by fressing 
<<ALTD> and <<CLEARD>> sinultaneously. 

The definiticn key for characters is displayed on 
the graph, as given in Figure 4.12. A series cf frint 
statements has been flace in FLTSCH to list the key in the 


righthand graph margin. 


_— 
{ 
e = DrVELOEMENT COST | 
Pe= FLIGHT TEST COMPLETICN DAT& 
Kk = RELIABILITY 
@ = ACCURACY 
% = TCTAL FEE EERCENTAGE 
Se= 9) CTAL COST 
We PTrTECTIVENESS INDEX | 
& = Several curves intersect : 


Figure 4. 12 Flot Character Key Definitions. 


The table displayed by "8. PLOT LAST SENSITIVITY 
mieuYSiS ACHIEVED VALUES." divides the screen height of 
twenty lines into the Largest value which 1s tc be 
displayed. This functions as the ordinate scale for the 
graph, Figure 4.13. PLTSCH displays the entire set of data. 
Mare the next selectior, "9. FLOT LAST SENSITIVITY ANALYSIS 
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FE& FERCENTAGES." the vertical axis is provided with a 
ecale¢ of 0.5 per line. The height of the ordinate Lecones 
10, which will display the fees up to 10%. The benefit of 
this'charge in scales is in the presentation of a nagnified 
view in the y-axis ketween the range of 0 and 10 where the 
fee percentages are concentrated. Figure 4.14 demonstrates 
the percentage graph. 

Graphing can also be scaled by the monitor. Chccsing 
Sensitivity Ment opticn number 10 directs PROJMNG to ask for 
the ranges which are to be used for the y-axis. Figure 4.15 
demonstrates the interactive exchange between the prcgran 
and user to create the desired y-scale. The program accepts 
any values for the minimum and maximua values for the axis. 
The prograz again divides this range into 20 steps. The step 
$1ze kecemes the y-axis scale. If the scale is less tnan 
0.05 rer line, PROJMNG resets the scale to 0.05. Figure 
4.16 demonstrates the grapo resulting from the steps in 
megure 4.15. 


| Ts ee 
MAI’ MENU: | 
| 1. CHANGE TEAM NUMEER 
Pomel nek DE SsLeCTICN QUERY { 
eeeethr ENPUT SELECTION NEND | 
Hee neFUN THE DATA CALCULATICN 
See DO AN SENSITIVITY ANALYSIS 
Oe Ee RINICUL CCST+ FACTORS 
Peeve RINT LAST SENEIIIVITY TABLE. 
BeepectCY LAST SENSTIIVITY ANALYSIS ACHIEVED VALUES. 
Wreee Cl TAS. SENSTIEVILTY ANALYSIS Fee PSRCZNIAGES. 
mereerLOr WETH SSALECTEDIY-AXIS SCALES. 
iemecce OPTIMUM ET VALUE FCM LAST SENSTIVITY 
Peat aALyoto 2OR Lr=3 DATA. 
Zs. EXIT 
| 
a a See ee 


Figure 4.15 Monitor's Main Menu in Mode 1. 
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5. Effectiveness Index 


Selection 11 on the Sensitivity Menu provides the 
Bonitor with a means of directly copying into the data array 
(Selection Menu) the best sensitivity parameter value for 
the bighest EI value. SNSITIV determines the best occurrence 
of the nighest value of Effectiveness Index. The EI with 
the lcwest farameter value is used for cost analysis, accu- 
Tacy analysis, and ccmpletion date analysis. For parameters 
mevOlVing *‘reliatility', the EI of the hignest faranreter 
value is stcred in EICPT. It will not make a chance of the 
optimum selection stcred in those cases where the ninisun 
value iS zero. It stores the sensitivity parameter's step 
number in variable EICPT. When option 11 is selected, the 
sensitivity parameter being evaluated has its value changed 
to that of the evaluation step which had been saved in 


EFIOPT. Fagure 4.17 demonstrates the revised Selecticn Menu. 


6. Flexible Menu Reset 


Shculd the mcnitor change the team, the DP level or 
the data irthe datarase the calculations made by SNSITIV 
are no longer applicable. FROCJMNG <flags the use of the 
Subroutines which generate these changes. Through the 
running cf these sukroutines, the flag which exfands the 
Sensitivity Menu is reset to ‘offi'. The option tc replot 
qraphs or tables based on the previous set of data is 
invalidated. 

Selection of the mode 2 option to "FILE TEA* 
FROPCSAL" generates the moniter mode flag MR. For mode 2, 
MR=2. This flag causes the tenu statement to file the 
proposal, and flags the program when leaving mode 2 either 
at exit cr on returo to the Monitor's Mode Menu to ask if 
the rewritten file should be sent to the PROJNNG disk. 
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Je SUMMARY 


The FROJMNG FORTRAN program retains its basic conmrfuta- 
tions and organizaticn -in ccmmon with the origiral CNP 
program. These basic features have been enhanced by improved 
user/frogram interaction, and by the reformulaticn of the 
achieved value fee percentage computation algorithn. 

FRCJMNG FORTRAN has an additional benefit over CNP in 
the extended sensitivity analysis capability it provides to 
the mcnitor. Both the sensitivity tables and graphs enhance 
the monitor's ability to evaluate the team's progress when 
uSing PRCJMNG. 
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A. SUMMARY 


The DMS exercise provides a time proven means of 
educating project managers in the potentials, sensitivities 
and incertives of acquisition management. This same cafa- 
rility is the significance of CNP and of PROJMNG as training 
aids in the DMS exercise. ‘The support of project management 
training Ey computer programs has existed for the past 
twenty years. This thesis has upgraded the availakle 
computer program suprfort for DNS. PROJMNG provides DMS with 
a user-friendly interactive tool to assist in the aquisition 


Management training frocess. 


Be. D&S 


DMS has proven te be an effective training exercise. It 
provides personnel in the Department of Defense, and 
personnel in other system acguisition environments, with 


relevant management training. 
1. Benefit 


The benefit of DMS as a training exercise is in the 
requirement it places on students to understand acquisition 
management concerts. It provides a sequenced set of events 
to develop, produce and deploy a missile The Decision 
Point's serve as planning milestones that the student teams 
must prepare for in order to successfully manage their 
acguisiticn project. Their understanding of the concepts of 
acquisition management is challenged by the exercise ina 


pseudo-real time scenario. 
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2. Computer Suprert 


=—= SP = 


Curing the twenty years in which DMS has been avail- 
able, tkere has been a revolution in the tools availakle to 
support preject management. The ability of computers to 
rapidly crganize, prcecess and correlate data has changed the 


acquisition management environment. 


DMS has adapted somewhat to management evoluticn by 
its incorporation and develorment of CNP. 

CNEF is an interactive Fortran program which has been 
used for the past decade. i Lis GUrbLent -conflguraticn,. it 
is difficult to use. Since it is not user friendly. 


Ce. FROJMNG 


In ecrder for D¥S to remain a relevant management 
training exercise, it must be kept current in its state-cf- 
the-art management ccncepts, training facility, and computer 
Support. The Fortran program PROJMNG has been created to 
provide DMS a program which is more aser-friendly. It is 
Beem gust an Off-shoot of CNP. TeolecorDObLaces SOLELOnS OF 
CNP ky virtue of utilizing most of the subroutines and algo- 
Cithms of CNP. PROJMNG improves the Fortran support for (MS 
in its refinement of CNP and by expanding the prcegranmed 


Suppcrt for analysis. 


1. Fenefits 


EFCJMNG's benefits include: 


e program access 

e program exit 

® session record 

eS wedataeclle Of 10 tut parameters 


e menus for cperation selection 
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e expanded sensitivity analysis 

e tables and graphs tc study parameter sensitivity 
e user-friendly displays 

¢ monitor-téam communication interaction 


through datafile exchange 


2. Shortcomings 


FROJMNG has not been completely validated. Its 
achieved values have not been tested sufriciently to deter- 
Mine its atility to react ina pseudo-realistic manner to 
parameter variations. 

Additionally, the programming facilities utilized in 
PROJMNG are not aS modern as they could be. The PRCJMNG 
capability has been hampered by the limitations of the 
mie 3033. Areas in which these limitations have iapacted 
PROJMNG are discussed in Chapter 6, Recommendations. 


3. First Usade 


So a a Soe ee emer smell emmeey 


FRCJUMNG has undergone a field test. It was used to 
support the Winter 1984 course in Project Management, 
AS-3501, taught at the Naval Postgraduate Schcol by Icdr. J. 
Ferris. This field test resulted in the following program 


enhancements: 


e Ability tc mass purge data files 

e Ability cf the monitor to send files to the 
EROJMNG disk 

e The SMSG autolog feature operates only when 
no users are accessed to the PROJMNG disk 

e All displays are formatted for 80 character 


wide rersonal computer (PC) display. 


e All exec guery resfonses are tested for input errcrs. 


e PROJMNG EXEC tests files for format before 
replacing the team disk copy. The file used 
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for the team database is sequentially the 
first one which exhibits the correct format 
from €ither the PROJMNG disk or the teana, 
and defaults to the file "FILE DATAFILE". 


During this field test, the pnajor problem in facilitating 
the f~rograg occurred in the autolog procedure. The SMSG 
automatic log-on of the PROJMNG disk occurred regardiess of 
users being on the disk. This situation resulted in files 
being read into the disk without proper organization. The 
files sukjected to this garbling were unusable. 

SMSG 1S now programmed to write the team files onto 
the FRCJMNG disk only when the disk is not accessed by any 
user. 


The wide usace of DMS in the U. S. and other coun- 
tries previded interest in making PROJMNG capable of use on 
various computer systems. CMS unigue features and IBM 
extenticns to fortran have teen discussed in this thesis to 
enable adartation. In its fresent form PROJMNG relies 
heavily on cCMS and its executive language facilities to 
Manipulate the data files outside of the Fortran prcgram 
envircnment. These facilities require assessment on a case 
ky case basis in order for FROJMNG to be usable on any 
system other than IBM's CMS with the FRICMS extention. 


ae FORTRAN 


The program has been compiled both cn_ the 
FORTRAN H and FORTEAN GI compilers of the NPS I5M-3033. 
PROJMNG is unable to compile in WATFIV (WATERLOO FCRTERAN). 
The ccrplication which precludes the WATFIV compilaticn is 
the call to FRTICMS. It is desirable to not remove the FaRTCNS 
calls. they provide a major enhancenent to the pregram by 





enabling the program to clear tne screen, ‘'CLESCRN '. Less 


ef this feature would disorganize the PROJMNG displays. 


LT. LOCUMENTATION 


j= cNE 


A major proklem in working with a program is its 
documentaticn. CNP has several styles of documentaticn. 
There are periodic lines of text to label or explain the 
programs operation. These comments were beneficial in 
reconstructing scme cf the program operation, but inadequate 
in deciptering the prcgram operation. 

The best documentation present in CNP were the names 
selected for variables. Each of the input variables, a 
Dajority cf the computaticnal variaoles andthe rcutine 
Mames were carefully selected to provide a relaticn with 
their data definiticn or with the process they represent. 
The variables in most of CNP are acronyms. 


2. ERCJMNG 


EROJMNG contains additional comments throughout the 
program code taken frem CNP. Frequent comments have been 
added to explain the processes accomplished by groups cf 
code and routines. All of the terms added to the program by 
FROJMNG are meanineful acronyms for the routines and 


variatles. 


3. Glossary 





Appendix H provides a glossary of the terms used in 
both CNP and PROJMNG. Compilation of the glossary provides a 
documentation method which supplements the benefit cbtained 
from selecting variakles which are acronyms for the content 
definiticn. Some definitions for CNP terms in the glossary 


remain undetermined. 
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4. Debugging 


Terms used 1nN a@ program without adequate documenta- 
ti0n may interact in unexpected areas of theiprogram. With 
3063 variables in the program, CNP is a maze of connections 
ketween variables. Tracking the details of terms used in CNP 
mas difficult. The two worst aspects of terms in CNF are 
multiple definitions for aterm and manipulation of the 
variakles tc change the value's power-or-ten multiple. For 
example, RATIO is used in CNP to determine the percentage of 
a fee to te awarded, it is aiso used as a value of niilicns 
c£ dcllars faid for fees, and it 1s used in a resource ratio 
calculation. An examrle of the manipulation of variables is 
the array C1IC(8). This array is used in millions cf dollars 
and in dcllars. 

The disadvantage in using mixed definitions fora 
variable is the impact which occurs on calculations which 
depend on the variatle. If a calculation 1s based cn a 
specific multiple of the variable and it has varying values 
dependent on which sukroutine used it last, the programmer 
cannot utilize the variable. He must consider the inability 
> predict the occurrence of changes to the variables 
definiticn. 
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VI. RECOMMENDATIONS FOR FUTURE CONSIDERATION 
The flanning, design and execution of this revisicn to 


CNP have generated the following recomnendations. 


e Increase the program suppert to the exercise 

e Expand the program to Supfort more Decision Points 
in the DMS exercise 

e Develop a DMS ccmputer assisted tutorial 

e Validate the achieved values 

e Change the data tables to formulas 

e Increase the sensitivity analysis capabilities 

e Improve the grafhics resolution 

e Change the tenu displays to ‘plate' displays 

e Develorc a program to create project management 
exercise scenarios for actual system acguisiticns 


e Use PRCJMNG to encompass other CNP program variations 


A. INCREASED EXERCISE SUPPORT 
1. Dascussion 


The wide availability of personal computers provides 
project panagers and students with improved data processing 
capability. They new have computation capability availalle 
to them instantaneously throughcut the acquisiticn precess 
fer storing and analyZing their own Specific acquisition 
data. If DMS is to continue to provide project managers 
with training at the level now availaple in the management 
environment, it must have scftware facility equivalert to at 
least that cf their fersonal systems. It is feasible toc ake 
the DMS program compatible with PCs. DMS must be suppcrted 





at the state-of-the-art. re must be contemporary in 
Froviding a prcgram which has the degree of comruter 
facility which the managers experience in day-to-day use and 
in actual acquisition planning. AS this capability 
develops, the program supporting DMS should expand to: 


e Support all DMS Decision Point levels 
e Interface with student and manager PCs 


e Support actual acquisition scenarios 


2. FReccmmendaticn 


Cesign new frogram carabilities to permit DMS adaptation for 
broader application to PC's and to change the acquisition 
Management frocess. 


Beh INCLUDE ALL DECISICN POINTS 


1. LEiscussica 


Foth CNP and PROJMNG support the DMS exercise only 
for CF-3 and DP-4. The present DMS scenario includes six 
Peeisicn Pcints. All of the DP's reguire team analysis of 
the exercise parameters and submission of Decision Sheets 
(see Appendix B). These characteristics are conducive to 
Micorroration of these CP's into other PROJMNG like 
analyses. 

Use of an interactive computer progran to sufpert 
CP*s 71 and 2 would provide an opportunity for each team to 
do a rEetter analysis in these early Decision Points, and to 
initiate the team database for later use. Inclusion of ail 
DP's in the program would permit documentation of the entire 


team exercise performance in one computer record. 
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2. keccmmendaticn 


A future computer support program for DMS snould be 


designed tc expand exercise support from the PROJMNG and CNP 
capability cf DP 3 and 4 evaluation to all exercise DP's. 


C. DEVELOP A DMS TUTCRIAL 


1. Liscussion 


Computer tutcrials have become a popular methcd of 
Ped ning . The availability cf computer assets for CNP or 
FROJMNG indicates the presence of computer hardware to 
Support a tutorial [frogran. Student interaction with a 
computer supported DMS tutorial could be used to intreduce 
the student to the DMS exercise, to perform sample prokilens, 
and to give examrles. 

The one-on-one capability for student reponse tca 
CMS tutorial should te limited to exercise orientaticn and 
Zam ttacization. DE’s 2 through 6 provide an opportunity 
for a té€am-work experience. This team interaction should 


remain ar integral part of the DMS exercise. 


Ze Recommendaticn 


Inccrporate the DMS training scenario into an acqui- 
Sition tanagement tutorial. Tae tutorial is seen as 


Peoviding: 


scenario presentaticn to the individual 


e review of initial fositions 


aid to students to remedy difficulty 
with concepts 
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De. VALICATE PROJMNG 


1. Discussion 





i Correlation of achieved values between the 
CNP/FRCJMNG programs andthe DMS data values has not been 
demonstrated. An analysis should be conducted in order to 
determine if the algorithms in PROJMNG provide realistic 
approximaticns to the full DMS batch progran. 

Evidence exists of differences between some CNE and 
PROJMNG results. Eitker program may be at fault. PRCJMNG's 
errors result from its acceptance of the algorithms and 
calculations contained in the original CNP progran. The 
values ccmputed by CNP can not be assumed to be accurate. 

Current classroom usage of PROJMNG has’ been pfredi- 
cated on the assumpticn that these values indeed perform as 
should te expected. This assumption was based on the inccr- 
Foration of the Fortran code for the achieved values calcu- 
laticn from CNP into FROJMNG. 


2- Reccmmendaticr 


A series of evaluations should be conducted to 
compare the actual CMS batch outputs and with the fserforn- 
ance of ERCJMNG. 


Ee REPLACE THE DATA TABLES WITH EQUATIONS 


1. Discussion 


The tables of values included in CNP/PROJMNG have 
limited range in which performance data can be oktained. 
Beyond these limits data values are not available for calcu- 
lations. In most cases, CNP does not warn the user that he 
has perfcrmed a calculation which is not a feasible solu- 
e100 « In most cases, PROJMNG forces the team to resubmit 


data items which are outside the range caparilities 


cc 





discussed in the DMS instructions. There are parameters for 
which limits are not specified in the DMS handouts, and 
which can result in unusual calculations such as achieving a 
flight test completicn date of 0.: 

There are twe reascns for redesigning the pregran 
resource value algcrithms which are used to calculate 
achieved values. First 1S to provide a continuous function 
instead of a step function. The table values read for 
calculations in both CNP and PROJMNG do aot provide contin- 
uous value functions. Second the values have a limited 
range. Student selections which are beyond the capability of 
the table result in erroneous achieved values, such ag the 
flight test example atove. 

The results provided by CNP and PROJMNG, as 
discussed in Chapter 1, are not actual results. They repre- 
sent apprcximate results to reflect the real world issue of 
eontract isk. 

The programming of equations to obtain the rescurce 
values will result in the need to validate the achieved 
values predictions. Validating the values achieved asa 
result of changing the resource ailocation algorithm would 
ke of equal complexity to validating PROJMNG's current 
results. Both validaticn projects would verify the 
program's capability to produce realistic predicted contract 
performance values. In the interest of reducing the expen- 
diture of effort between these two validations, the effort 
would te best applied in one project. To validate PRCJMNG 
and later reguire revalidation for a new algorithr would 


obviate the former. 


2. Reccommendaticna 


PIlESt, redesign and implement the egquaticns for 
determining resource allocations. Second, validate the 


entire new program package of PROJMNG for DMS support. 
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Fe. INCREASE SENSITIVITY ANALYSIS OPTIONS 


1. Discussion 


The options available in the sensitivity analysis 
menu de not have as dramatic an effect in demonstrating the 
impact of incentives and other parameters as had been origi- 
hally expected. Sensitivity curves showing definite peaks or 
valleys in the achieved effectiveness index are not dencn- 
strated as readily as had been anticipated. The graphic 
presentation and sensitivity selection options shculd be 
designed tc provide the user with a clear depicticn cf the 
effect of ircentive variation. The user should Ee arle to 
readily determine from the sensitivity analysis products the 
bkenefits or disadvantages of changing his decision above or 
below his current position. 


2- Reccmmendaticn 


Determine other analysis options which may have 
greater value to the menitors. Conduct a series of analyses 
to determine if they affect tne sensitivity, and to elizi- 
nate these options which do not cause an achieved value 
fluctuation. 


Ge. IMPRCVED GRAPHICS 


1. Discussic 





Cne area of computer hardware and software develop- 
ment which is rapidly changing is graphics. The graph 
subroutine in PROJMNG waS specifically designed for the 
program and has a numter of limitations. No other IBY4-3033 
graphing program was found which provides multiple curve 
Graphing, selectable scales and the number of variaticns 
which ERCJMNG provides. A (continuous) curve plot is needed 
to enhance demonstration of parameter variations. The 
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graphic detail which is needed to improve the display dces 
not appear to be within the capability of the IBM~-3278 
terminals which are currently a widely available comrputer 
peripheral for student use, and which are particularly 
available in large guantities at NPS. What is needed is the 
ability to control screen display for continuous line flots. 
This type of resoluticn for the graphics on the IBM-3033 is 
not within the IBM-3278 terminals capability. Terminals do 
exist which provide greater screen control and which can be 
programmed to plot ccntinuous lines for the IBM. 

Display detail is undergoing evolution. The advan- 
tages cf color for highlighting presentations adds a perceép- 
tible benefit 1n human ability to comprehend. Color can be 
used to add a percepticn of relative weight of significance 
ketween curves and tetween pcintS ona curve.The use of 
characters and figure presentations which exceed the stan- 
dard typewriter characters in ASCII presentations increase 
the pictcrial communication of data. Both of these factcrs 
-colcr graphics and detailed display pixle control- are 
receiving widespread attention in interactive computer 
systems and shculd be considered as enhancements for 
computer support prcgqrams which will be successors tec CNP 
and PROJMNG. 

A kenefit to plotting continuous curves is the 
ability to Separate feints of curve intersection. Anctner 
benefit is the ability of continuous curves to show the 
connecticn ketween feints in the sane curve. The PROJMNG 
Flots readily demonstrate the ditficulty in presenting the 
different curves whose plots have a coinciding point. 

In the short term, use of Fortran capable disflays 
on the Tektronix 618 or the Ramtek does not appear reascn- 
able. Several factcrs degrade the significance of izple- 
menting cperation on a more ccmplex graphic system. One is 
the added processing time and cost for a display. The 
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second reason to not consider graphing the program cn a 
graphics display system is the rapid rate of technical 
development currently occurring. Based on the presence of 
hew IEM colcr graphics terminals at NPS, the facility at the 
We. R. Church Computer Center may be expected to provide high 
resoluticn color graphics for users in the not to distant 
future. In this case the effort to recode the PRCJMNG 
program fcr high resclution graphics on the Tektronix or the 
Ramtek graphics terminals would be obviated both in ccmrara- 
tive ccest and in utility. 

Another factcr which should be considered before 
programzing DMS suppcrt on a graphics unigue systen, such as 
CISSFILA, is whether the system will allow DMS tc remain 
transportable. CNP and PROJHNG were designed to be cost- 
effective ky their pctentially wide distribution and usage. 
The ccmmcn availability of the systems on which these two 
programs are based permits them to be widely copied. Use of 
unique display systems would reduce the tranportability and 


preclude spreading the cost over a wider user populaticn. 


“~ 


Ze neccnmendaticn 


Future computer programs to support DMS should 
demonstrate multi~coler plotting capability and continuous 


fae graphing. 


He. PLATE DISPLAYS 
> Ciscussion 


The Selection Menu disrlay sets a pattern of presen- 
tation of data throughout the FROJMNG program. Menu heading 
and cclumns of data labels remain consistent in the nonitor 
modes of operation, in the student mode of operation and in 
the display of data for the report submission tables. With 
the capability to produce plate displays, these factors 
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coulc be set into a file to be overlaid onto the screen. 
Items in the table are excellent candidates fora flate 
information display. The plate display capability would 
enable data item value change on the screen without 
reprinting the display and without the need to indicate 
which item is to be changed. The user will be able to flace 
the terminal curser on the data item value, change the 
values as desired, and submit the entire change as_ cne 
np t « 

Not only wculd the plate dispiay simplify data 
Change and operation, it would also eliminate the need for 
four cf the subroutines used in PROJMNG. The two change 
routines, the PAGEIN sucroutine and the FINISH subroutines 
could cre ccmbined into one benu with the Selection Menu 
format. 

Plate display capability would also be useful for 
the Sensitivity Analysis Menu. The format of this display 
could bre changed intc the same format as the Selection Menu. 
Much cf the sensitivity analysis routine could be eliminated 
with the saving in lines-of-code which the plate display 
represents. 

The IBM CMS II verSion currently being isplemented 
at the Naval Postgraduate School (NPS) contains this cafa- 
ae t y. Plate display capability for this program is 


expected to be availatle within the coming academic guarter. 


Adapt ERCJMNG to display plates as soon aS CMS II is 


implemented. 
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I. A SCENARIO GENERATING PROGRAM 


1. Eiscussicn 


Within the ‘computer simulation environment, concep- 
tual level programs have been demonstrated which permit the 
user to create his cwn decision support and analysis scer- 
aii O Application of this technology to DMS is envisioned 
as providing a program which can simulate any actual acaui- 
Ssiticn scenario. These ccncept level programs utilize a 
hierarchy of menus te query the user for arrays to estaklish 
the program dimensions. The program then queries the user 
for array size, array name, variables names, parameter 
ranges fcr the variakles and relative significance (weight) 
cf the variables within the parameter. A nierarehy of 
menu-driven routines guides the user to create a prcgran 
which supports the scenario to be studied. These programs 
enable the user te vary input variables in a matrix of 
parameters. The user constructs a scenario based on his 
concept of the parameters, on his feeling of their 
interaction and their relative significance. Based on these 
user perceptions such a program creates predictions fer the 
etfects cf the parameter interaction. These predictions are 
heavily weighted by user bias to parameter interacticn. 
Usually the program results predict what the user envisionzed 
because cf the impact of his tiases. The main benefit of 
scenario creation has proven to be the opportunity for the 
user to conduct a detailed management study of the situation 


keing modelled. 


2- keccmmendaticn 


Tevelop a prccgram whose design would permit frecject 
Managers to create frogram simulations tailored to assess 


their specific real-wcrld scenarios. 
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J. USE EROJMNG TO ENCOMPASS OTHER CNP VARIATIONS 


1. Discussion 


The design of PROJMNG around CNP routines with its 
cwnh routines performing the features which make it different 
from CNP makes it pessible for PROJMNG to encompass cther 
CNP variations. Any CNP style program which has the same 
common buffer of data could utilize PROJMNG's enhancements. 
The Euffer of common variakles in PROJMNG has been editted 
from that ccntained in CNP. The CNP buffer can be restored 
into FROJMNG, and does permit PROJMNG operation. 

The design of PROJMNG routines to support the calcu- 
laticns ckhtained in CNP suggest the potential of PROJMNG as 
a set of routines to enhance the user-friendliness of cther 
programs. Frograms which could generate the same data items 
as CNF could be used as a nucleus program whose data would 
re used Ey FROJMNG routines to conduct sensitivity analysis. 


Programs which are candidates for consideration are: 


e the main DMS batch game 
e the latest ICAF DMS version (SAFE 84) 
e the Swedish version called PMG/ZEBRA 


Investigate the use of PROJMNG as is or modified to 
ke ccmpatible with tke latest ICAF DMS version (SAFE 84) and 
the Swedish version called PMG/ZEBRA. Test the concert of 
using PROJMNG as an enhancement to the other Management 


acquisition programs. 
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Team Number 
1P=5 
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DEFENSE MANAGEMENT SIMULATION 


DECLSLON SHEER 5 


. OF the total funds approved by the Secretary of Defense, the following 
distribution is made for procurement of the ZEBRA Weapon System: 







a. Development Phase $ ; Million [1-4] 





b. Production Phase Million 


. The Development Contractor selected for ZEBRA System development 


BESS (enter appropriate contractor number) 
a. Midas Missile Corporation “contractor ly) 
b. Apex Aerospace, Incorporated (contractor 2) bey 


. The basic guidance approach selected for the ZEBRA System is: 
(enter appropriate approach number) 


a. Radar Inertial Guidance (G-1) (approach 1) 
b. All-Inertial Guidance (G-2) (approach 2) [10] 


. The guidance configuration selected for development is: 
(enter appropriate configuration number) 


a. "A' as primary, ''B" as parallel (configuration 1) 
b. “A alone | (configuration 2) 
c. "B'' as primary, "A" as paraliel (contiguration 3) 
fee o «alone (configuration 4) ly, 


meine development centract to be .cgotiated contains th- 
following features: 


a. Funds for the following activities. These funds are 
included in the total target development cost: 


(1) Maintainability Engineering $ : Million [12-15] 


aes SE 


(2) Valuc Engineering $ : Million [16-19] 


a 


(3) Parallel Guidance Development 
(ente. @ where not desired) $ ; Million [20-23] 


124 





Team Number 


DP-2 
DEC PolLON SHEET 3 

b. The following minimum technical PearOrmance Characteristics - 
(demonstrated at completion of flight tests) 
(1) Motor Sud-system Reliability : % [24-26] 
(2) Airframe Sub-system Reliability moh s [ 27529) 
(3) Lat icher/GSE Sub-system Reliability % [30-32] 
(4) Fire Control Sub-system Impact Error Yards “[oo-29)| 
(S) Guidance Sub-system Impact Error yards [36-53; 

c. The following numbers of sub-system Qualification Tests: 
(1) Motor Sub-system (20-40) {39-40} 
(2) Airframe Sub-system (3-9) [41] 
(3) Launcher/GSE -Sub-system (2-6) [42] 
(4) Fire Control Sub-system (2-4) pas 
(5S) Guidance Sub-system (3-9) [44] 

d. The following number or Flight Tests: (10-25) [45-46] 


6. Decision Point 


Team Number 


Card Number 
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Team Number 


DECISTCN SHEET 5 
7. The incentive provisions for this development contract (subject 
to negotiations) are as follows: 
NOTE: If any area is not incentivized, enter the target value 


for both the maximum and minimum fee values, enter @ 
for the maximum fee percentage. 


a. Development Program Cost: 


Maximum Cost (minimum fee value) 5 : Mid 2on "liao. 
Minimum Cost (maximum fee value) > : Million ,4-6] 
Maximum Fee Percentage ; % [7-9] 


b. Schedule; Completion of Flight Tests: 


Latest Week (minimum fee value) Week No. [10-i2! 
Earliest Week (maximum fee value) Week No. [15-15] 
Maximum Fee Percentage % [16-i8. 


c. System Reliability: 


Maximum Reliability (mu.imum fee value) * {19-20] 
Minimum Reliability (mininwun fee value) % 21-22] 
Maximum Fee Percentage : % [25-2 
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DECTSTON SSHEER 3 


ieeovystem Impact Error: 


Maximuin Error (poorest accuracy) 


(minimum fee value) 


Minimum Error (best accuracy) 


(maximum fee value) 


Maximum Fee Percentage 


8. Production Decisions: 


a. The desired date for completion of 
deployment of lot TEN is: 


Week No. 


Team Number 





yards [26-28] 


yards [29-31] 


oo? 


(32234) 


__ __s «[44-46] 


Be Fabrication of Block I missiles is to start after: 


(1) Qualification Tests 
[concurrent (fabrication 1)] 
(2) Flight Tests 
[fly-before-buy (fabrication 2)] 


pee lass - 
Decision Point 
Team Number 


Card Number 
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Team Number 


DP-4 
DEFENSE MANAGEMENT SIMULATION 
DECISION SHEET 4 
1, The Development Contractor selected for ZEBRA System development 
eis (enter appropriate contractor number) 
a. Midas Missile Corporation (contractor 1) 
b. Apex Aerospace, Incorporated (contractor 2) [1] 
2. The basic guidance approach selected for the ZEBRA System is: 
(enter appropriate approach number) 
a. Radar Inertial Guidance (G-1) (approach 1) 
b. All-Inertial Guidance (G-2) (approach 2) 12] 
3. The final guidance configuration selected for development and 
production is: (enter appropriate configuration number) 
a. "A' configuration (configuration 2) 
b. "B'' configuration (configuration 4) [3] 
4. The revised development contract contains the following 
features: 
a. Funds for the fuilcwing accivities: 
(If you do not desire to expend additional funds in these 
areas, enter the appropriate amounts expended at DP-3. 
If you do desire to expend additional funds in these 
areas, enter the total amounts you now desire.) 
(1) Maintainability Engineering $ : Million [4-6] 
(2) Value Engineering $ : Million [7-9] 
b. [fc Monitor's Use Only] 0 0 0 [10-12] 





Team Number 


DP-4 
DECISION SHEET 4 

c. The foliowing minimum technical performance characteristics: 
(demonstrated at completion of flirht tests) 
(1) Motor Sub-system Reliability : oo S= 55) 
(2) Airframe Sub-system Reliability - % ~[36-38] 
(3) Launcher/GSE Sub-system Reliability ; *% [39-41] 
(4) Fire Control Sub-system Impact Error yards [42-44] 
(5) Guidance Sub-system Impact Error yards [40--7] 

d. The Sollowing numbers of sub-system Quslification Tests: 
(1) Motoz sub-system (20-40) [42-49] 
(2) Airframe Sub-system (3-9) [SO] 
(5) Launcher/GSE Sub-system (2-6) fol 
(4) Fire Control Sub-system (2-4) (523 
(5) Guidance Sub-system (3-9) [$3] 

e. The following ntber of Flight Tests: (10-25) [54-55] 


5. Decision Point 
Team Number 


Card Number 
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Team Number 


DP -- 
DECISION SHEET 4 
6. The incentive provisions for this development contract (subject 
to negotiations) are as follows: 
NOTE: If any area is not incentivized, enter the target value 
for both the maximum and minimum fee values, enter 9 
for the maximum fee percentage. 
a. Development Program Cost: 
Maximum Cost (minimum fee value) $ ; Million “(l-s 
Minimum Cost (maximum fee value) $ : Million [4-6] 
Maximum Fee Percentage ‘ % [7-9] 
b. Schedule; Completion of Flight Tests: 
Latest Week (minimum fee value) Week No. ene tes 
Earliest Week (maximum fee value) Week No. [15-15] 
Maximum Fee Percentage : % [16-18] 
c. System Reliability: 
Maximum Reliability (maximum fee value) % [19-20] 
Minimum Reliability (mininun fee value) % [21-22] 
Maximum Fee Percentage ; % [23-25] 


ne 0 





Team Number 


- DP-4 
DECISION SHEET 4 
d. System Impact Error: 
Maximum Error (poorest accuracy) 
(minimum fee value) yards [26-28] 
Minimum Error (best accuracy) 
(maximum fee value) yards [29-31] 
Maximum Fee Percentage % [32-34] 
7, Production Decisions: 
a. The Development Contractor is to procure the following 
number of lots of long-lead time components in 
preparation for Block I production: 
[44-45] 
b. The earliest Lot TEN deployment date for which fixed 
price proposals are desired is: 
Week No. [46-48] 
c. Fabrication of Block I missiles is to start after: 
(1) Qualification Tests 
{concurrent (fabrication 1)] 
(2) Flight Tests 
[fly-before-buy (fabrication 2)] Cl 6r. 2) [49] 


8. Class [73-74] 
Decision Point [76] 
Team Number [77-78] 


Card Number [80] 
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